-- Logs begin at Mon 2021-11-15 23:48:19 UTC, end at Tue 2021-11-16 00:45:34 UTC. -- Nov 16 00:20:01.448539 dv-cinder-811154-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 16 00:20:01.457332 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 16 00:20:01.459331 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 16 00:20:01 2021] *** Nov 16 00:20:01.459331 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 16 00:20:01.459331 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 16 00:20:01.459331 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: nodename: dv-cinder-811154-2-iscsi Nov 16 00:20:01.459331 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: machine: x86_64 Nov 16 00:20:01.459331 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: clock source: unix Nov 16 00:20:01.459331 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: pcre jit disabled Nov 16 00:20:01.459331 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: detected number of CPU cores: 4 Nov 16 00:20:01.459331 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: current working directory: / Nov 16 00:20:01.459331 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: detected binary path: /usr/bin/uwsgi-core Nov 16 00:20:01.460113 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: your processes number limit is 47680 Nov 16 00:20:01.460113 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: your memory page size is 4096 bytes Nov 16 00:20:01.460113 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: detected max file descriptor number: 2048 Nov 16 00:20:01.460113 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: lock engine: pthread robust mutexes Nov 16 00:20:01.460113 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: thunder lock: enabled Nov 16 00:20:01.460113 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 16 00:20:01.460113 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 16 00:20:01.503656 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: Python main interpreter initialized at 0x5607a5b7d9c0 Nov 16 00:20:01.503656 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: python threads support enabled Nov 16 00:20:01.503656 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: your server socket listen backlog is limited to 100 connections Nov 16 00:20:01.503656 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: your mercy for graceful operations on workers is 90 seconds Nov 16 00:20:01.504079 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: mapped 403077 bytes (393 KB) for 2 cores Nov 16 00:20:01.504079 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: *** Operational MODE: preforking *** Nov 16 00:20:01.504350 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: *** uWSGI is running in multiple interpreter mode *** Nov 16 00:20:01.504350 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: spawned uWSGI master process (pid: 107126) Nov 16 00:20:01.504563 dv-cinder-811154-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 16 00:20:01.508290 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: spawned uWSGI worker 1 (pid: 107127, cores: 1) Nov 16 00:20:01.508290 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: spawned uWSGI worker 2 (pid: 107128, cores: 1) Nov 16 00:20:01.508290 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 16 00:20:03.172494 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 00:20:03.172494 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: from cryptography.utils import int_from_bytes Nov 16 00:20:03.173811 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 00:20:03.173811 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: from cryptography.utils import int_from_bytes Nov 16 00:20:03.175646 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 00:20:03.175646 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: from cryptography.utils import int_from_bytes Nov 16 00:20:03.176491 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 00:20:03.176491 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: from cryptography.utils import int_from_bytes Nov 16 00:20:05.882843 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 00:20:05.883427 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 00:20:05.883581 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 00:20:05.883943 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 00:20:05.884196 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 00:20:05.884534 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 00:20:05.884914 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.885002 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 00:20:05.885099 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.885209 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.885298 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 00:20:05.885530 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.885631 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 00:20:05.885847 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 00:20:05.885947 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.886155 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.886245 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.886476 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.886570 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.886794 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.886885 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.887158 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.887275 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.887425 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.887520 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.887741 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.887839 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.888067 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-811154-2-iscsi {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.888166 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.888390 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.888506 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.888700 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.888812 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.889002 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.889102 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.889321 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.889420 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.889627 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.889731 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-811154-2-iscsi {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.889947 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.890037 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.890251 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.890367 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.890565 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.890747 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.890889 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.891946 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.892102 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.892213 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.892310 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.892388 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.892463 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.892603 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.892692 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.892828 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.892920 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.893003 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.893086 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.893175 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.893258 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.893392 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.893537 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.893647 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.893851 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.893961 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.894162 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.894358 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-811154-2-iscsi {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.894484 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.894676 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.894795 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.894992 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.895150 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.895343 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.895468 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.895758 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.895866 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-811154-2-iscsi {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.896072 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.896187 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.896385 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.896496 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.896709 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.896816 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.897032 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.897180 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.897386 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.897507 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.897792 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.897892 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.898115 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.898211 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.898436 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.898524 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.898743 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.898883 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.899086 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.899189 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.899385 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.899477 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.899696 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.899794 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.900015 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.900105 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.900320 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.900414 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.900622 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.900706 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.900873 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.900965 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.901182 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.901275 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.901507 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.901598 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.901827 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.901912 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.902079 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.902178 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.902387 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.902481 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.902636 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.902727 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.902955 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.903068 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.903311 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.903442 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.903589 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.903680 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.903841 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.903933 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.904163 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.904247 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.904487 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.904587 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.904798 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.904888 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.905105 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.905189 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.905414 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.905530 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.905721 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.905814 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.906030 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.906124 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.906339 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.906441 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.906648 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.906746 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.906952 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.907079 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.907298 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.907408 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.907618 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.907724 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.907928 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.908019 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.908236 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.908341 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.908555 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.908646 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.908885 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.908975 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.909195 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.909280 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.909502 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.909593 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.909825 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.909912 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.910134 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.910225 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.910443 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.910534 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.910753 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.910842 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.911087 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.911174 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.911407 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.911493 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.911712 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.911795 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.911965 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.912050 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.912267 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.912358 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.912574 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.912667 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.912920 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.913070 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.913230 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.913314 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.913624 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.913718 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.913935 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.914019 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.914256 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.914341 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.914564 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.914664 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.914872 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.914956 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.915204 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.915303 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.915515 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.915637 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.915822 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.915922 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.916127 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.916218 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.916434 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.916543 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.916740 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.916839 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.917043 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.917140 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.917345 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.917445 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.917657 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.917765 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.917966 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.918070 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.918269 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.918360 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.918577 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.918663 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.918886 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.918983 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.919219 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.919307 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.919528 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.919611 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.919835 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.919919 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.920146 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.920234 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.920452 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.920548 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.920760 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.920853 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.921068 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.921158 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.921372 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.921463 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.921679 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.921764 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.921990 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.922073 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.922287 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.922369 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.922593 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.922683 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.922903 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.922990 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.923234 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.923330 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.923794 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.923885 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.924102 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.924194 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.924409 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.924504 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.924713 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.924805 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.925019 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.925104 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.925321 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.925411 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.925630 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.925812 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.925931 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.926079 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.926235 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.926325 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.926544 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.926641 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.926852 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.926936 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.927176 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.927265 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.927482 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.927578 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.927802 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.927886 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.928113 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.928203 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.928968 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.929066 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.929304 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.929465 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.929696 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:20:05.929786 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.929955 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.930090 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.930295 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.930423 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.930644 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.930735 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.930963 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.931067 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.931327 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.931414 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.931669 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.931762 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.931987 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.932073 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.932300 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.932390 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.932609 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.932701 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.932964 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.933069 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.933241 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.933324 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.933555 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.933648 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.933872 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.933961 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.934193 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.934304 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.934512 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.934604 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.934822 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.934905 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.935167 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.935256 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.935488 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.935582 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.935815 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.935912 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.936123 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.936248 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.936441 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.936543 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.936775 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.936860 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.937096 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.937186 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.937408 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.937499 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.937730 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.937822 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.938055 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.938140 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.938372 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.938467 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.938688 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.938773 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.939003 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.939115 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.939350 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.939436 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.939668 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.939759 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.939979 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.940062 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.940293 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.940377 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.940615 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.940699 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.940929 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.941025 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.941240 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.941325 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.941548 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.941640 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.941856 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.941954 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.942169 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.942253 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.942477 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.942562 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.942783 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.942876 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.943113 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.943211 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.943429 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.943516 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.943741 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.943841 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.944117 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.944770 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.944988 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.945083 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.945236 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.945405 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.945571 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.945715 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.945882 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.946031 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.946201 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.946345 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.946516 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.946653 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.946826 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.946979 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.947168 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.947319 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.947485 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.947628 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.947792 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.947952 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.948120 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.948259 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.948438 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.948567 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.948749 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.948883 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.949076 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.949195 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.949388 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.949509 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.949698 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.949863 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.950016 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.950133 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.950331 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.950447 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.950647 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.950760 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.950960 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.951117 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.951312 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.951451 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.951635 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.951751 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.951950 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.952070 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.952286 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.952395 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.952621 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.952707 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.952933 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.953017 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.953267 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.953389 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.953594 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.953678 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.953902 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.953985 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.954207 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.954289 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.954514 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.954606 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.954820 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.954904 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.955153 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.955255 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.955462 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.955554 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.955764 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.955847 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.956068 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.956151 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.956373 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.956458 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.956682 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.956768 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.956983 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.957075 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.957286 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.957370 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.957586 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.957676 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.957914 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.958005 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.958219 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.958302 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.958524 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.958613 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.958829 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.958922 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.959207 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.959304 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.959527 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.959616 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.959924 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.960009 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.960245 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.960333 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.960560 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.960644 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.960876 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.960960 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.961190 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.961275 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.961502 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.961586 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.961827 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.961913 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.962141 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.962227 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.962462 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.962588 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.962778 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.962874 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.963128 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.963246 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.963443 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.963538 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.963764 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.963855 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.964068 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.964150 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.964386 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.964478 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.964698 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.964788 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.965023 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.965107 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.965333 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.965425 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.965654 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.965738 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.965963 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.966046 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.966281 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.966378 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.966593 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.966677 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.966907 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.966990 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.967256 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.967355 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.967570 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.967655 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.967882 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.967965 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.968190 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.968322 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.968502 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.968630 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.968810 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.968894 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.969131 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.969217 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.969438 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.969520 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.969757 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.969839 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.970058 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.970149 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.970373 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.970465 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.970687 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.970770 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.971012 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.971159 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.971348 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.971432 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.971662 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.971747 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.971984 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.972077 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.972294 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.972385 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.972604 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.972697 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.972916 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.973009 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.973222 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.973306 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.973529 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.973622 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.973838 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.973921 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.974151 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.974233 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.974459 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.974551 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.974768 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.974851 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.975093 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.975181 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.975459 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.975562 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.975771 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.975864 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.976080 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.976213 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.976380 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.976467 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.976691 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.976779 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.977014 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.977098 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.977326 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.977411 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.977643 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.977726 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.977960 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.978051 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.978263 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.978354 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.978567 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.978652 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.978889 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.978972 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.979228 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.979317 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.979537 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.979621 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.979843 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.979938 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.980145 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.980235 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.980471 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.980561 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.980780 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.980873 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.981082 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.981165 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.981393 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.981477 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.981740 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.981839 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.982051 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.982142 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.982357 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.982448 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.982671 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.982766 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.982983 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.983094 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.983326 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.983420 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.983638 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.983730 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.983948 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.984035 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.984259 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.984341 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.984569 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.984659 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.984880 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.984963 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.985187 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.985270 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.985504 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.985590 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.985813 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.985896 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.986123 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.986205 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.986431 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.986522 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.986737 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.986823 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.987077 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.987183 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.987382 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.987466 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.987697 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.987954 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.988038 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.988294 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.988379 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.988610 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.988694 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.988932 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.989176 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.989277 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.989510 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.989594 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.989831 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.989968 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.990153 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.990247 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.990475 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.990559 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.990791 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.991411 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.991742 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.991840 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.992071 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.992156 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.992389 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.992481 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.992698 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.992784 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.993008 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.993093 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.993317 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.993402 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.993623 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.993709 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.993935 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.994017 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.994241 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.994324 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.994543 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.994627 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.994846 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.994929 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.995176 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.995283 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.995486 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.995588 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.995792 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.995877 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.996102 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.996185 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.996406 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.996502 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.996723 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.996815 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.997030 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.997120 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.997335 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.997420 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.997638 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.997723 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.997938 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.998020 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.998260 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.998349 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.998566 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.998692 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.998874 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.998966 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.999202 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.999302 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.999549 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.999643 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.999855 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:05.999946 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.000159 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.000259 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.000488 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.000574 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.000795 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.000880 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.001100 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.001192 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.001406 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.001498 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.001716 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.001801 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.002028 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.002113 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.002334 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.002418 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.002636 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.002720 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.002944 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.003028 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.003280 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.003374 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.003584 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.003676 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.003872 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.003959 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.004183 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.004275 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.004489 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.004574 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.004797 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.004881 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.005101 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.005191 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.005406 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.005498 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.005755 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.005846 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.006023 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.006106 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.006329 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.006425 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.006686 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.006771 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.007002 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.007171 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.007336 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.007503 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.007648 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.007826 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.007956 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.008134 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.008267 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.008442 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.008571 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.008748 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.008890 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.009060 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.009197 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.009370 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.009502 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.009676 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.009809 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.010001 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.010121 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.010314 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.010433 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.010620 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.010739 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.010932 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.011093 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.011263 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.011410 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.011570 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.011722 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.011882 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.012034 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.012207 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.012339 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.012527 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.012644 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.012834 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.012956 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.013145 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.013283 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.013450 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.013599 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.013755 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.013889 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.014059 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.014222 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.014367 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.014510 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.014672 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.014817 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.014974 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.015145 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.015302 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.015457 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.015606 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.015762 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.015914 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.016065 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.016236 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.016370 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.016547 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.016674 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.016852 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.016978 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.017157 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.017302 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.017458 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.017612 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.017802 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.017916 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.018104 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.018221 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.018463 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.018549 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.018769 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.018893 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.019178 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.019280 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.019427 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.019519 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.019740 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.019837 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.020054 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.020139 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.020368 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.020453 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.020673 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.020756 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.020989 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.021081 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.021302 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.021394 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.021612 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.021696 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.021917 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.022000 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.022746 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.022844 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.023079 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.023167 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.023392 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.023520 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.023700 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.023844 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.024025 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.024175 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.024341 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.024503 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.024654 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.024835 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.024979 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.025145 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.025306 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.025460 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.025640 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.025784 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.025948 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.026101 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.026263 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.026415 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.026580 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.026733 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.026895 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.027097 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.027232 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.027387 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.027547 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.027703 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.027862 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.028019 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.028176 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.028334 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.028490 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.028647 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.028805 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.028961 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.029118 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.029277 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.029425 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.029587 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.029739 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.029916 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.030054 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.030231 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.030365 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.030542 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.030696 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.030855 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.031010 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.031188 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.031343 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.031504 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.031664 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.031811 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.031974 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.032244 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.032329 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.032561 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.032646 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.032875 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.033004 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.033184 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.033320 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.033498 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.033635 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.033812 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.033943 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.034129 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.034260 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.034446 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.034576 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.034754 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.034896 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.035199 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.035299 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.035516 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.035608 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.035835 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.035949 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.036150 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.036283 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.036457 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.036550 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.036762 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.036846 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.037076 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.037168 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.037403 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.037487 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.037709 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.037850 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.038082 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.038178 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.038396 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.038507 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.038704 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.038788 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.039008 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.039168 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.039359 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.039444 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.039668 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.039775 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.039996 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.040081 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.040383 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.040468 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.040721 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.040804 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.041031 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.041118 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.041398 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.041482 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.041724 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.041808 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.042048 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.042140 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.042375 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.042459 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.042678 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.042762 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.042993 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.043139 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.043332 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.043425 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.043650 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.043751 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.043965 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.044050 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.044278 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.044382 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.044593 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.044688 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.044902 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.044987 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.045220 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.045304 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.045530 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.045624 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.045851 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.045934 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.046175 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.046258 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.046496 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.046589 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.046824 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.046909 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.048155 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.048263 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.048361 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.048703 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.048811 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.048904 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.048984 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.049062 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.049139 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.049272 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.049373 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.049502 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.049596 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.049676 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.049760 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.049838 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.049924 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.050004 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.050197 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.050282 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.050510 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.050595 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.050825 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.050911 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.051158 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.051246 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.051469 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.051553 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.051774 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.051883 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.052088 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.052173 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.052390 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.052482 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.052713 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.052804 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.053020 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.053105 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.053340 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.053957 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.054388 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.054497 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.054605 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.054692 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.054929 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.055028 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.055264 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.055350 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.055569 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.055652 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.055876 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.055976 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.056186 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.056273 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.056492 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.056577 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.056799 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.056886 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.057132 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.057223 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.057442 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.057526 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.057767 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.057854 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.058079 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.058163 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.058413 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.058506 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.058726 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.058812 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.059039 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.059143 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.059381 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.059483 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.059708 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.059795 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.060011 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.060094 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.060318 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.060412 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.060631 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.060716 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.060935 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.061018 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.061237 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.061334 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.061543 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.061635 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.061850 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.061933 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.062153 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.062252 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.062458 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.062542 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.062759 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.062842 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.063082 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.063184 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.063394 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.063478 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.063716 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.063801 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.064022 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.064109 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.064324 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.064422 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.064631 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.064730 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.064932 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.065031 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.065237 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.065321 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.065544 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.065629 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.065882 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.065967 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.066184 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.066268 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.066523 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.066607 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.066845 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.066930 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.067178 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.067264 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.067507 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.067604 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.067824 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.067908 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.068140 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.068231 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.068456 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.068550 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.068772 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.068856 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.069144 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.069277 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.069475 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.069559 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.069793 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.069960 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.070105 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.070294 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.070425 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.070618 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.070742 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.070937 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.071091 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.071290 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.071611 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.071704 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.071933 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.072018 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.072264 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.072581 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.072767 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.072850 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.072929 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.073147 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.073232 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.073468 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.073567 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.073786 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.073878 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.074100 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.074192 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.074417 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.074504 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.074733 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.074837 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.075061 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.075150 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.075390 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.075477 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.075707 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.075799 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.076042 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.076127 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.076367 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.076460 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.076684 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.076768 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.077004 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.077099 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.077326 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.077424 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.077643 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.077740 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.077960 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.078055 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.078278 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.078363 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.078596 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.078682 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.078916 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.079002 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.079267 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.079354 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.079582 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.079728 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.079894 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.079981 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.080212 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.080298 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.080524 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.080620 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.080836 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.080935 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.081148 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.081234 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.081465 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.081570 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.081777 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.081869 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.082092 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.082183 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.082418 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.082512 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.082734 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.082820 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.083104 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.083195 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.083396 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.083517 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.083701 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.083839 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.084033 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.084217 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.084354 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.084532 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.085196 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.085403 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.085734 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.085818 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.086060 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.086154 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.086384 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.086470 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.086702 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.086787 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.087030 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.087140 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.087360 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.087446 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.087667 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.087755 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.087981 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.088067 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.088293 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.088378 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.088600 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.088695 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.088914 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.088999 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.089223 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.089306 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.089527 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.089622 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.089848 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.089933 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.090162 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.090258 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.090468 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.090689 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.090776 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.091041 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.091194 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.091380 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.091638 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.091733 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.091994 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.092079 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.092321 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.092413 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.092625 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.092711 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.092949 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.093042 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.093256 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.093341 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.093562 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.093649 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.093880 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.093965 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.094189 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.094273 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.094495 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.094579 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.094802 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.094887 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.095136 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.095235 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.095450 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.095539 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.095757 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.095842 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.096071 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.096167 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.096377 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.096462 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.096684 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.096768 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.097002 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.097096 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.097304 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.097388 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.097611 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.097704 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.097922 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.098017 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.098227 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.098311 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.098529 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.098612 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.098834 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.098928 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.099160 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.099250 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.099467 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.099551 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.099770 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.099905 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.100074 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.100203 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.100426 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.100574 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.100738 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.100826 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.101041 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.101132 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.101347 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.101432 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.101648 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.101733 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.101955 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.102039 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.102265 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.102356 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.102570 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.102661 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.102886 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.102969 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.103218 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.103318 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.103527 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.103620 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.103841 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.103933 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.104155 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.104315 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.104486 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.104571 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.104802 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.104886 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.105115 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.105345 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.105484 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.105684 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.105912 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.106028 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.106304 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.106402 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.106641 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.106734 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.106979 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.107101 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.107324 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.107411 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.107633 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.107718 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.107960 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.108045 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.108275 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.108390 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.108586 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.108678 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.108901 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.108986 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.109215 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.109301 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.109527 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.109611 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.109839 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.109931 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.110152 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.110274 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.110464 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.110696 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.110782 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.111016 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.111189 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.111389 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.111631 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.111717 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.111955 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.112054 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.112311 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.112403 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.112630 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.112723 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.113031 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.113141 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.113258 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.113392 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.113569 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.113655 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.113878 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.113963 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.114192 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.114277 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.114506 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.114599 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.114818 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.114905 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.115159 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.115248 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.115494 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.115580 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.115811 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.118663 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.118663 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.118811 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.118888 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.118888 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.119106 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.119190 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.119268 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.119345 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.119433 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.119526 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.119607 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.119684 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.119764 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.119840 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.119916 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.120001 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.120069 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.120141 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.120226 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.120312 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.120391 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.120458 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.120535 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.120612 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.120688 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.120765 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.120917 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.121045 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.121252 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.121359 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.121583 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.121694 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.121894 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.122010 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.122206 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.122335 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.122515 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.122646 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.122875 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.123005 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.123202 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.123300 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.123525 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.123624 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.123856 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.123942 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.124172 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.124258 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.124502 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.124597 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.124819 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.124905 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.125130 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.125220 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.125443 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.125537 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.125754 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.125841 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.126066 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.126159 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.126382 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.126475 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.126693 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.126778 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.127006 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.127108 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.127353 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.127448 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.127668 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.127752 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.127982 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.128067 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.128296 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.128383 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.128615 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.128706 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.128933 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.129027 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.129239 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.129323 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.129567 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.129659 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.129879 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.129973 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.130195 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.130280 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.130506 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.130592 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.130817 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.130914 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.131153 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.131243 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.131471 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.132130 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.132336 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.132428 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.132664 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.132750 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.132991 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.133076 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.133320 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.133406 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.133659 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.133744 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.133971 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.134054 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.134306 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.134397 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.134630 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.134722 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.134873 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 00:20:06.134959 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.135319 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.135638 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.135987 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.136318 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:20:06.136565 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 00:20:06.157893 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG oslo_db.sqlalchemy.engines [None req-aa75a27e-4b9b-444e-aba3-d812094ae4cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 00:20:06.158837 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_db.sqlalchemy.engines [None req-aad009fe-0e2e-429d-837c-40c0ce66aff9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 00:20:06.336950 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.context [None req-aad009fe-0e2e-429d-837c-40c0ce66aff9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e9e03b1-3ea8-4563-a932-133fe83355c3(cell1) {{(pid=107127) load_cells /opt/stack/nova/nova/context.py:464}} Nov 16 00:20:06.338474 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.context [None req-aa75a27e-4b9b-444e-aba3-d812094ae4cb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e9e03b1-3ea8-4563-a932-133fe83355c3(cell1) {{(pid=107128) load_cells /opt/stack/nova/nova/context.py:464}} Nov 16 00:20:06.341315 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_concurrency.lockutils [None req-aad009fe-0e2e-429d-837c-40c0ce66aff9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:20:06.342790 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG oslo_concurrency.lockutils [None req-aa75a27e-4b9b-444e-aba3-d812094ae4cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:20:06.342904 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_concurrency.lockutils [None req-aad009fe-0e2e-429d-837c-40c0ce66aff9 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:20:06.343716 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_concurrency.lockutils [None req-aad009fe-0e2e-429d-837c-40c0ce66aff9 None None] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:20:06.344408 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG oslo_concurrency.lockutils [None req-aa75a27e-4b9b-444e-aba3-d812094ae4cb None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:20:06.345232 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG oslo_concurrency.lockutils [None req-aa75a27e-4b9b-444e-aba3-d812094ae4cb None None] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:20:06.345651 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_concurrency.lockutils [None req-aad009fe-0e2e-429d-837c-40c0ce66aff9 None None] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:20:06.347193 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG oslo_concurrency.lockutils [None req-aa75a27e-4b9b-444e-aba3-d812094ae4cb None None] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:20:06.357054 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_db.sqlalchemy.engines [None req-aad009fe-0e2e-429d-837c-40c0ce66aff9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 00:20:06.359478 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_db.sqlalchemy.engines [None req-aad009fe-0e2e-429d-837c-40c0ce66aff9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 00:20:06.363539 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG oslo_db.sqlalchemy.engines [None req-aa75a27e-4b9b-444e-aba3-d812094ae4cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 00:20:06.365754 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG oslo_db.sqlalchemy.engines [None req-aa75a27e-4b9b-444e-aba3-d812094ae4cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 00:20:06.629319 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_db.sqlalchemy.engines [None req-aad009fe-0e2e-429d-837c-40c0ce66aff9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 00:20:06.640786 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG oslo_db.sqlalchemy.engines [None req-aa75a27e-4b9b-444e-aba3-d812094ae4cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 00:20:06.973088 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: WARNING keystonemiddleware.auth_token [None req-aad009fe-0e2e-429d-837c-40c0ce66aff9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 00:20:06.973648 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: WARNING keystonemiddleware.auth_token [None req-aa75a27e-4b9b-444e-aba3-d812094ae4cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 00:20:06.979604 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: WARNING keystonemiddleware.auth_token [None req-aad009fe-0e2e-429d-837c-40c0ce66aff9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 00:20:06.980360 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: WARNING keystonemiddleware.auth_token [None req-aa75a27e-4b9b-444e-aba3-d812094ae4cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 00:20:07.328237 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: WARNING keystonemiddleware.auth_token [None req-aa75a27e-4b9b-444e-aba3-d812094ae4cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 00:20:07.332260 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: WARNING keystonemiddleware.auth_token [None req-aad009fe-0e2e-429d-837c-40c0ce66aff9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 00:20:07.333574 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: WARNING keystonemiddleware.auth_token [None req-aa75a27e-4b9b-444e-aba3-d812094ae4cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 00:20:07.338410 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: WARNING keystonemiddleware.auth_token [None req-aad009fe-0e2e-429d-837c-40c0ce66aff9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 00:20:07.340485 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5607a5b7d9c0 pid: 107128 (default app) Nov 16 00:20:07.342726 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-aa75a27e-4b9b-444e-aba3-d812094ae4cb None None] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:20:07.343947 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-aa75a27e-4b9b-444e-aba3-d812094ae4cb None None] 10.222.0.31 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001896 Nov 16 00:20:07.344359 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 1/1] 10.222.0.31 () {50 vars in 788 bytes} [Tue Nov 16 00:20:07 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:20:07.344772 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5607a5b7d9c0 pid: 107127 (default app) Nov 16 00:21:34.865552 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-aa75a27e-4b9b-444e-aba3-d812094ae4cb None None] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:21:34.866703 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-aa75a27e-4b9b-444e-aba3-d812094ae4cb None None] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Nov 16 00:21:34.867256 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 2/2] 10.222.0.31 () {54 vars in 930 bytes} [Tue Nov 16 00:21:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:21:35.384337 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-57de8ffa-ccd9-4f88-a0b7-356f284e498e admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:21:35.421533 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-57de8ffa-ccd9-4f88-a0b7-356f284e498e admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.545903 Nov 16 00:21:35.434467 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 1/3] 10.222.0.31 () {60 vars in 1291 bytes} [Tue Nov 16 00:21:34 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:21:37.839709 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-aa75a27e-4b9b-444e-aba3-d812094ae4cb None None] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:21:37.841357 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-aa75a27e-4b9b-444e-aba3-d812094ae4cb None None] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002090 Nov 16 00:21:37.847120 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 3/4] 10.222.0.31 () {54 vars in 930 bytes} [Tue Nov 16 00:21:37 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:21:37.918148 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-64198d84-1662-45f9-8ee0-2154174f04dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "id": "c1", "swap": 0}} {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:21:37.938156 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:21:37.938156 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: warnings.warn(msg) Nov 16 00:21:37.970584 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-64198d84-1662-45f9-8ee0-2154174f04dd admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.119772 Nov 16 00:21:37.971482 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 2/5] 10.222.0.31 () {64 vars in 1282 bytes} [Tue Nov 16 00:21:37 2021] POST /compute/v2.1/flavors => generated 407 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:21:38.197302 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-533fe4b6-d6e6-46a4-bf09-81d387ee8f9f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:21:38.199722 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:21:38.199722 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: warnings.warn(msg) Nov 16 00:21:38.254163 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-533fe4b6-d6e6-46a4-bf09-81d387ee8f9f admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.272790 Nov 16 00:21:38.255766 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 4/6] 10.222.0.31 () {64 vars in 1335 bytes} [Tue Nov 16 00:21:37 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:21:40.626180 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-64198d84-1662-45f9-8ee0-2154174f04dd admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:21:40.627333 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-64198d84-1662-45f9-8ee0-2154174f04dd admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001977 Nov 16 00:21:40.627842 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 3/7] 10.222.0.31 () {54 vars in 930 bytes} [Tue Nov 16 00:21:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:21:40.794694 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-7d2b4b9e-9035-4068-9b6b-e06a8d974c90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "os-flavor-access:is_public": true, "swap": 0, "id": "d1", "vcpus": 1, "disk": 5}} {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:21:40.814837 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:21:40.814837 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: warnings.warn(msg) Nov 16 00:21:40.837718 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-7d2b4b9e-9035-4068-9b6b-e06a8d974c90 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.201495 Nov 16 00:21:40.838286 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 5/8] 10.222.0.31 () {64 vars in 1282 bytes} [Tue Nov 16 00:21:40 2021] POST /compute/v2.1/flavors => generated 404 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:21:40.851204 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-62cdeea3-ffe1-42ef-9d67-4060e298ac13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:21:40.852675 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:21:40.852675 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: warnings.warn(msg) Nov 16 00:21:40.888365 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-62cdeea3-ffe1-42ef-9d67-4060e298ac13 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041311 Nov 16 00:21:40.888973 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 4/9] 10.222.0.31 () {64 vars in 1335 bytes} [Tue Nov 16 00:21:40 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:21:43.480963 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-7d2b4b9e-9035-4068-9b6b-e06a8d974c90 admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:21:43.481991 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-7d2b4b9e-9035-4068-9b6b-e06a8d974c90 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Nov 16 00:21:43.482414 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 6/10] 10.222.0.31 () {54 vars in 930 bytes} [Tue Nov 16 00:21:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:21:43.581333 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-c4496f93-6153-4da0-807e-50f406bd71f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:21:43.605035 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-c4496f93-6153-4da0-807e-50f406bd71f1 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.114463 Nov 16 00:21:43.605731 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 5/11] 10.222.0.31 () {64 vars in 1282 bytes} [Tue Nov 16 00:21:43 2021] POST /compute/v2.1/flavors => generated 404 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:21:43.621601 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-617826af-e4d8-481e-9fca-574a636c2dab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:21:43.650373 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-617826af-e4d8-481e-9fca-574a636c2dab admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032412 Nov 16 00:21:43.650953 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 7/12] 10.222.0.31 () {64 vars in 1335 bytes} [Tue Nov 16 00:21:43 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:21:46.230433 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-c4496f93-6153-4da0-807e-50f406bd71f1 admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:21:46.231496 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-c4496f93-6153-4da0-807e-50f406bd71f1 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Nov 16 00:21:46.231930 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 6/13] 10.222.0.31 () {54 vars in 930 bytes} [Tue Nov 16 00:21:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:21:46.295769 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-d2b4325a-eb55-4ad6-b1c6-c2c92d529730 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:21:46.314474 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-d2b4325a-eb55-4ad6-b1c6-c2c92d529730 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075859 Nov 16 00:21:46.315074 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 8/14] 10.222.0.31 () {64 vars in 1282 bytes} [Tue Nov 16 00:21:46 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:21:46.327779 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-ac8e5e45-eaed-4c9d-ab85-251f5d964337 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:21:46.353579 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-ac8e5e45-eaed-4c9d-ab85-251f5d964337 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029298 Nov 16 00:21:46.354261 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 7/15] 10.222.0.31 () {64 vars in 1335 bytes} [Tue Nov 16 00:21:46 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:21:48.793069 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-d2b4325a-eb55-4ad6-b1c6-c2c92d529730 admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:21:48.794076 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-d2b4325a-eb55-4ad6-b1c6-c2c92d529730 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Nov 16 00:21:48.794489 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 9/16] 10.222.0.31 () {54 vars in 930 bytes} [Tue Nov 16 00:21:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:21:48.864777 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-f6eb39a5-a445-4f50-b920-27deb4adf68c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "name": "ds4G", "disk": 20, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4"}} {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:21:48.885428 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-f6eb39a5-a445-4f50-b920-27deb4adf68c admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081393 Nov 16 00:21:48.886087 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 8/17] 10.222.0.31 () {64 vars in 1282 bytes} [Tue Nov 16 00:21:48 2021] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:21:48.899741 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-0544cb1c-605b-4a35-b3fa-d0a817d6c9c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:21:48.929226 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-0544cb1c-605b-4a35-b3fa-d0a817d6c9c2 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033124 Nov 16 00:21:48.929935 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 10/18] 10.222.0.31 () {64 vars in 1335 bytes} [Tue Nov 16 00:21:48 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:21:51.392163 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-f6eb39a5-a445-4f50-b920-27deb4adf68c admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:21:51.393215 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-f6eb39a5-a445-4f50-b920-27deb4adf68c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001751 Nov 16 00:21:51.393555 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 9/19] 10.222.0.31 () {54 vars in 930 bytes} [Tue Nov 16 00:21:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:21:51.496647 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-700b1b11-8861-46b9-9f33-14395c6384e6 admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:21:51.529407 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-700b1b11-8861-46b9-9f33-14395c6384e6 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.128011 Nov 16 00:21:51.529956 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 11/20] 10.222.0.31 () {60 vars in 1291 bytes} [Tue Nov 16 00:21:51 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:21:54.293013 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-f6eb39a5-a445-4f50-b920-27deb4adf68c admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:21:54.294462 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-f6eb39a5-a445-4f50-b920-27deb4adf68c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001929 Nov 16 00:21:54.295476 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 10/21] 10.222.0.31 () {54 vars in 930 bytes} [Tue Nov 16 00:21:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:21:54.387784 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-664fa101-5d1f-4a4f-a83a-39cf7574fa7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "id": "1", "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:21:54.409203 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-664fa101-5d1f-4a4f-a83a-39cf7574fa7d admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.103269 Nov 16 00:21:54.410258 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 12/22] 10.222.0.31 () {64 vars in 1282 bytes} [Tue Nov 16 00:21:54 2021] POST /compute/v2.1/flavors => generated 402 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:21:54.426278 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-a0854787-f055-40c9-aa06-61f054de4292 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:21:54.458598 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-a0854787-f055-40c9-aa06-61f054de4292 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037030 Nov 16 00:21:54.459481 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 11/23] 10.222.0.31 () {64 vars in 1332 bytes} [Tue Nov 16 00:21:54 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:21:57.169474 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-664fa101-5d1f-4a4f-a83a-39cf7574fa7d admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:21:57.171380 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-664fa101-5d1f-4a4f-a83a-39cf7574fa7d admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003248 Nov 16 00:21:57.172477 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 13/24] 10.222.0.31 () {54 vars in 930 bytes} [Tue Nov 16 00:21:57 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:21:57.254283 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-b98a8795-5078-412b-b128-17551d467957 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 20, "id": "2", "swap": 0, "rxtx_factor": 1.0, "name": "m1.small", "vcpus": 1}} {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:21:57.283670 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-b98a8795-5078-412b-b128-17551d467957 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.099859 Nov 16 00:21:57.285496 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 12/25] 10.222.0.31 () {64 vars in 1282 bytes} [Tue Nov 16 00:21:57 2021] POST /compute/v2.1/flavors => generated 405 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:21:57.306200 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-d91131ee-0fa9-46fc-9bc7-ffcd312243ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:21:57.344259 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-d91131ee-0fa9-46fc-9bc7-ffcd312243ef admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046747 Nov 16 00:21:57.344935 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 14/26] 10.222.0.31 () {64 vars in 1332 bytes} [Tue Nov 16 00:21:57 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:21:59.734466 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-b98a8795-5078-412b-b128-17551d467957 admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:21:59.735501 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-b98a8795-5078-412b-b128-17551d467957 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Nov 16 00:21:59.735905 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 13/27] 10.222.0.31 () {54 vars in 930 bytes} [Tue Nov 16 00:21:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:21:59.801170 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-58153397-19d9-45f1-a108-80a4884b85ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "ram": 4096, "id": "3", "vcpus": 2}} {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:21:59.823992 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-58153397-19d9-45f1-a108-80a4884b85ac admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.081266 Nov 16 00:21:59.824572 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 15/28] 10.222.0.31 () {64 vars in 1282 bytes} [Tue Nov 16 00:21:59 2021] POST /compute/v2.1/flavors => generated 406 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:21:59.838579 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-3a0d1491-ec58-4cd8-8d96-76086e971414 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:21:59.865434 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-3a0d1491-ec58-4cd8-8d96-76086e971414 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030473 Nov 16 00:21:59.866255 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 14/29] 10.222.0.31 () {64 vars in 1332 bytes} [Tue Nov 16 00:21:59 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:22:02.304103 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-58153397-19d9-45f1-a108-80a4884b85ac admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:02.307590 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-58153397-19d9-45f1-a108-80a4884b85ac admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003493 Nov 16 00:22:02.308670 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 16/30] 10.222.0.31 () {54 vars in 930 bytes} [Tue Nov 16 00:22:02 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:22:02.375219 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-4babb01b-6189-4fdd-9aa4-b30bc757774c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "name": "m1.large", "id": "4"}} {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:22:02.397445 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-4babb01b-6189-4fdd-9aa4-b30bc757774c admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081827 Nov 16 00:22:02.405794 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 15/31] 10.222.0.31 () {64 vars in 1282 bytes} [Tue Nov 16 00:22:02 2021] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:22:02.413251 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-b99ab5c7-767d-4eec-b8e2-d7606570cbcc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:22:02.441845 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-b99ab5c7-767d-4eec-b8e2-d7606570cbcc admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034763 Nov 16 00:22:02.442427 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 17/32] 10.222.0.31 () {64 vars in 1332 bytes} [Tue Nov 16 00:22:02 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:22:04.872918 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-4babb01b-6189-4fdd-9aa4-b30bc757774c admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:04.874291 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-4babb01b-6189-4fdd-9aa4-b30bc757774c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Nov 16 00:22:04.874291 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 16/33] 10.222.0.31 () {54 vars in 930 bytes} [Tue Nov 16 00:22:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:22:04.949261 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-efa41a1a-be67-4720-b020-936825aba5c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 160, "id": "5", "name": "m1.xlarge", "swap": 0, "ram": 16384, "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:22:04.970559 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-efa41a1a-be67-4720-b020-936825aba5c4 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.087926 Nov 16 00:22:04.972469 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 18/34] 10.222.0.31 () {64 vars in 1282 bytes} [Tue Nov 16 00:22:04 2021] POST /compute/v2.1/flavors => generated 408 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:22:04.990611 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-b7a686a8-65bf-490f-ab80-b9cec945311d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:22:05.032273 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-b7a686a8-65bf-490f-ab80-b9cec945311d admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046873 Nov 16 00:22:05.033154 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 17/35] 10.222.0.31 () {64 vars in 1332 bytes} [Tue Nov 16 00:22:04 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:22:44.770025 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-efa41a1a-be67-4720-b020-936825aba5c4 admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:44.771030 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-efa41a1a-be67-4720-b020-936825aba5c4 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Nov 16 00:22:44.771468 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 19/36] 10.222.0.31 () {54 vars in 930 bytes} [Tue Nov 16 00:22:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:22:44.833533 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-af5b186a-c578-46d6-9e5d-92d529ea2251 admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:44.850977 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-af5b186a-c578-46d6-9e5d-92d529ea2251 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072955 Nov 16 00:22:44.851545 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 18/37] 10.222.0.31 () {60 vars in 1291 bytes} [Tue Nov 16 00:22:44 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:22:46.337609 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-efa41a1a-be67-4720-b020-936825aba5c4 admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:46.338623 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-efa41a1a-be67-4720-b020-936825aba5c4 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Nov 16 00:22:46.339016 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 20/38] 10.222.0.31 () {56 vars in 1074 bytes} [Tue Nov 16 00:22:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:22:46.529982 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-74583d0d-da4c-482e-8cc4-72de252241db admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:46.536580 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.wsgi [None req-74583d0d-da4c-482e-8cc4-72de252241db admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 16 00:22:46.537148 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-74583d0d-da4c-482e-8cc4-72de252241db admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=107127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:22:46.537947 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-74583d0d-da4c-482e-8cc4-72de252241db admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059743 Nov 16 00:22:46.538470 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 19/39] 10.222.0.31 () {60 vars in 1190 bytes} [Tue Nov 16 00:22:46 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 00:22:46.549347 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-a277e890-c4db-4929-a3cb-a7b23793bf07 admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:46.570258 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-a277e890-c4db-4929-a3cb-a7b23793bf07 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025455 Nov 16 00:22:46.570820 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 21/40] 10.222.0.31 () {60 vars in 1210 bytes} [Tue Nov 16 00:22:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:22:46.582016 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-3286f199-b0f2-41fc-ad0c-a96cfd01332a admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:46.603735 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-3286f199-b0f2-41fc-ad0c-a96cfd01332a admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026011 Nov 16 00:22:46.604314 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 20/41] 10.222.0.31 () {60 vars in 1210 bytes} [Tue Nov 16 00:22:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:22:46.614430 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-4a24d708-87c3-465c-8b61-01732f2e0770 admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:46.620100 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.wsgi [None req-4a24d708-87c3-465c-8b61-01732f2e0770 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 16 00:22:46.620705 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-4a24d708-87c3-465c-8b61-01732f2e0770 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=107128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:22:46.621431 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-4a24d708-87c3-465c-8b61-01732f2e0770 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010717 Nov 16 00:22:46.621928 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 22/42] 10.222.0.31 () {60 vars in 1190 bytes} [Tue Nov 16 00:22:46 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 00:22:47.980447 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-3286f199-b0f2-41fc-ad0c-a96cfd01332a admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:47.981456 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-3286f199-b0f2-41fc-ad0c-a96cfd01332a admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Nov 16 00:22:47.981847 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 21/43] 10.222.0.31 () {56 vars in 1074 bytes} [Tue Nov 16 00:22:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:22:48.173795 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-d3a77df1-cc06-4faa-965c-072f1a2c9196 admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:48.179269 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.wsgi [None req-d3a77df1-cc06-4faa-965c-072f1a2c9196 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 16 00:22:48.179908 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-d3a77df1-cc06-4faa-965c-072f1a2c9196 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=107128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:22:48.180782 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-d3a77df1-cc06-4faa-965c-072f1a2c9196 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061739 Nov 16 00:22:48.181391 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 23/44] 10.222.0.31 () {60 vars in 1190 bytes} [Tue Nov 16 00:22:48 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 00:22:48.192060 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-8b16d226-49f3-466d-addf-e70d1111ddbf admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:48.206286 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-8b16d226-49f3-466d-addf-e70d1111ddbf admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018511 Nov 16 00:22:48.206835 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 22/45] 10.222.0.31 () {60 vars in 1210 bytes} [Tue Nov 16 00:22:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:22:48.216996 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-704c069a-79b8-40c1-99bb-deb1ebc4a0e3 admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:48.230628 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-704c069a-79b8-40c1-99bb-deb1ebc4a0e3 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017163 Nov 16 00:22:48.231218 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 24/46] 10.222.0.31 () {60 vars in 1210 bytes} [Tue Nov 16 00:22:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:22:48.241872 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-a2f37d34-5dfb-4dcb-9f44-0c09eecadf96 admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:48.247232 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.wsgi [None req-a2f37d34-5dfb-4dcb-9f44-0c09eecadf96 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 16 00:22:48.247788 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-a2f37d34-5dfb-4dcb-9f44-0c09eecadf96 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=107127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:22:48.248564 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-a2f37d34-5dfb-4dcb-9f44-0c09eecadf96 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010333 Nov 16 00:22:48.249068 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 23/47] 10.222.0.31 () {60 vars in 1190 bytes} [Tue Nov 16 00:22:48 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 00:22:49.621089 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-704c069a-79b8-40c1-99bb-deb1ebc4a0e3 admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:49.622086 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-704c069a-79b8-40c1-99bb-deb1ebc4a0e3 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Nov 16 00:22:49.622482 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 25/48] 10.222.0.31 () {56 vars in 1074 bytes} [Tue Nov 16 00:22:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:22:49.816456 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-fa02fc1f-0e05-46b9-9f69-3bf85719495f admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:49.822221 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.wsgi [None req-fa02fc1f-0e05-46b9-9f69-3bf85719495f admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 16 00:22:49.822871 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-fa02fc1f-0e05-46b9-9f69-3bf85719495f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=107127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:22:49.823637 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-fa02fc1f-0e05-46b9-9f69-3bf85719495f admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061951 Nov 16 00:22:49.824153 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 24/49] 10.222.0.31 () {60 vars in 1193 bytes} [Tue Nov 16 00:22:49 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 00:22:49.834019 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-7ceb4db5-66ae-45a2-9c06-80e4202451cb admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:49.847592 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-7ceb4db5-66ae-45a2-9c06-80e4202451cb admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017209 Nov 16 00:22:49.848134 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 26/50] 10.222.0.31 () {60 vars in 1210 bytes} [Tue Nov 16 00:22:49 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:22:49.858124 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-145cb8b2-fe1a-43f6-a28b-8928b593c11d admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:49.872169 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-145cb8b2-fe1a-43f6-a28b-8928b593c11d admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017509 Nov 16 00:22:49.872712 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 25/51] 10.222.0.31 () {60 vars in 1210 bytes} [Tue Nov 16 00:22:49 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:22:49.883431 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-cef48577-fdb5-4617-bcd4-badf2f05f47f admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:49.888652 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.wsgi [None req-cef48577-fdb5-4617-bcd4-badf2f05f47f admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 16 00:22:49.889202 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-cef48577-fdb5-4617-bcd4-badf2f05f47f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=107128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:22:49.889972 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-cef48577-fdb5-4617-bcd4-badf2f05f47f admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010149 Nov 16 00:22:49.890471 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 27/52] 10.222.0.31 () {60 vars in 1193 bytes} [Tue Nov 16 00:22:49 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 00:22:51.256672 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-145cb8b2-fe1a-43f6-a28b-8928b593c11d admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:51.257707 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-145cb8b2-fe1a-43f6-a28b-8928b593c11d admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Nov 16 00:22:51.258103 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 26/53] 10.222.0.31 () {56 vars in 1074 bytes} [Tue Nov 16 00:22:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:22:51.456032 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-49145d0d-df40-42e1-943f-495e6560342c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:22:51.476116 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-49145d0d-df40-42e1-943f-495e6560342c admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.074097 Nov 16 00:22:51.476576 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 28/54] 10.222.0.31 () {64 vars in 1235 bytes} [Tue Nov 16 00:22:51 2021] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:22:53.007808 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-145cb8b2-fe1a-43f6-a28b-8928b593c11d admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:53.008818 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-145cb8b2-fe1a-43f6-a28b-8928b593c11d admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Nov 16 00:22:53.009219 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 27/55] 10.222.0.31 () {56 vars in 1074 bytes} [Tue Nov 16 00:22:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:22:53.203973 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-3a601d43-814f-4f59-a143-f7b21077eb7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:22:53.221942 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-3a601d43-814f-4f59-a143-f7b21077eb7f admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069975 Nov 16 00:22:53.222435 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 29/56] 10.222.0.31 () {64 vars in 1235 bytes} [Tue Nov 16 00:22:53 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:22:54.636384 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-145cb8b2-fe1a-43f6-a28b-8928b593c11d admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:54.637416 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-145cb8b2-fe1a-43f6-a28b-8928b593c11d admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Nov 16 00:22:54.637814 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 28/57] 10.222.0.31 () {56 vars in 1074 bytes} [Tue Nov 16 00:22:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:22:54.833281 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-329f9dbb-74ef-4c3f-8740-72e25541146e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:22:54.851887 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-329f9dbb-74ef-4c3f-8740-72e25541146e admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.073162 Nov 16 00:22:54.852432 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 30/58] 10.222.0.31 () {64 vars in 1235 bytes} [Tue Nov 16 00:22:54 2021] POST /compute/v2.1/flavors => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:22:56.249667 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-145cb8b2-fe1a-43f6-a28b-8928b593c11d admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:56.250668 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-145cb8b2-fe1a-43f6-a28b-8928b593c11d admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Nov 16 00:22:56.251083 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 29/59] 10.222.0.31 () {56 vars in 1074 bytes} [Tue Nov 16 00:22:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:22:56.449531 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-1b85ecdb-f481-42c0-bf65-47ebf7ef8961 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:22:56.466576 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-1b85ecdb-f481-42c0-bf65-47ebf7ef8961 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.074363 Nov 16 00:22:56.467090 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 31/60] 10.222.0.31 () {64 vars in 1235 bytes} [Tue Nov 16 00:22:56 2021] POST /compute/v2.1/flavors => generated 409 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:22:57.850272 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-145cb8b2-fe1a-43f6-a28b-8928b593c11d admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:57.851316 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-145cb8b2-fe1a-43f6-a28b-8928b593c11d admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Nov 16 00:22:57.851727 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 30/61] 10.222.0.31 () {56 vars in 1074 bytes} [Tue Nov 16 00:22:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:22:58.051861 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-4f83e93f-5191-4ce3-9de8-53e49cf0b11c admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:22:58.072160 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-4f83e93f-5191-4ce3-9de8-53e49cf0b11c admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.077372 Nov 16 00:22:58.072756 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 32/62] 10.222.0.31 () {60 vars in 1202 bytes} [Tue Nov 16 00:22:57 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:23:44.119446 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-145cb8b2-fe1a-43f6-a28b-8928b593c11d admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:23:44.120454 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-145cb8b2-fe1a-43f6-a28b-8928b593c11d admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Nov 16 00:23:44.120851 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 31/63] 10.222.0.31 () {54 vars in 930 bytes} [Tue Nov 16 00:23:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:23:44.184010 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-31c5b251-c3e4-4dfb-8ed3-c85cc52944e5 admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:23:44.205470 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-31c5b251-c3e4-4dfb-8ed3-c85cc52944e5 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076751 Nov 16 00:23:44.206039 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 33/64] 10.222.0.31 () {60 vars in 1291 bytes} [Tue Nov 16 00:23:44 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:23:44.246968 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-f666cbbd-8008-4a86-a0cb-8e584be401f4 admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:23:44.262964 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-f666cbbd-8008-4a86-a0cb-8e584be401f4 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.022653 Nov 16 00:23:44.264055 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 32/65] 10.222.0.31 () {60 vars in 1282 bytes} [Tue Nov 16 00:23:44 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:23:44.283238 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-e901497b-8439-4565-af42-61ac45c7c11f admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:23:44.291681 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-e901497b-8439-4565-af42-61ac45c7c11f admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012208 Nov 16 00:23:44.292281 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 34/66] 10.222.0.31 () {60 vars in 1285 bytes} [Tue Nov 16 00:23:44 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:23:44.305279 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-0a541329-c61b-41fd-b1f4-f9cd5f3509d8 admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:23:44.314311 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-0a541329-c61b-41fd-b1f4-f9cd5f3509d8 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012628 Nov 16 00:23:44.314889 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 33/67] 10.222.0.31 () {60 vars in 1285 bytes} [Tue Nov 16 00:23:44 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:23:44.327532 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-c62b34a9-3506-42f6-8756-8e345dc1a65c admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:23:44.336913 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-c62b34a9-3506-42f6-8756-8e345dc1a65c admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012993 Nov 16 00:23:44.337488 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 35/68] 10.222.0.31 () {60 vars in 1282 bytes} [Tue Nov 16 00:23:44 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:25:09.694001 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-d52443d2-babc-48fd-a37f-1d07be42350c tempest-verify_tempest_config-1113569438 tempest-verify_tempest_config-1113569438-project] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:25:09.695959 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-d52443d2-babc-48fd-a37f-1d07be42350c tempest-verify_tempest_config-1113569438 tempest-verify_tempest_config-1113569438-project] 10.222.0.31 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.109952 Nov 16 00:25:09.696484 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 34/69] 10.222.0.31 () {58 vars in 1133 bytes} [Tue Nov 16 00:25:09 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:26:33.129333 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-c62b34a9-3506-42f6-8756-8e345dc1a65c admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:26:33.130339 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-c62b34a9-3506-42f6-8756-8e345dc1a65c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Nov 16 00:26:33.130736 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 36/70] 10.222.0.31 () {56 vars in 1074 bytes} [Tue Nov 16 00:26:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:26:33.384044 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-5c916d7b-3650-4d68-ac2b-a035350f49d2 admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:26:33.385179 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:26:33.385179 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: warnings.warn(msg) Nov 16 00:26:33.386689 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_concurrency.lockutils [None req-5c916d7b-3650-4d68-ac2b-a035350f49d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:26:33.387156 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_concurrency.lockutils [None req-5c916d7b-3650-4d68-ac2b-a035350f49d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:26:33.387937 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_concurrency.lockutils [None req-5c916d7b-3650-4d68-ac2b-a035350f49d2 admin admin] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:26:33.388360 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_concurrency.lockutils [None req-5c916d7b-3650-4d68-ac2b-a035350f49d2 admin admin] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:26:33.421932 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-5c916d7b-3650-4d68-ac2b-a035350f49d2 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.148965 Nov 16 00:26:33.422503 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 35/71] 10.222.0.31 () {60 vars in 1193 bytes} [Tue Nov 16 00:26:33 2021] GET /compute/v2.1/os-services => generated 791 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:26:34.806391 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-c62b34a9-3506-42f6-8756-8e345dc1a65c admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:26:34.807442 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-c62b34a9-3506-42f6-8756-8e345dc1a65c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Nov 16 00:26:34.807876 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 37/72] 10.222.0.31 () {56 vars in 1074 bytes} [Tue Nov 16 00:26:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:26:35.003504 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-3e7c4441-5a95-4d3f-b948-a7b1a53ec00e admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:26:35.004658 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:26:35.004658 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: warnings.warn(msg) Nov 16 00:26:35.006161 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_concurrency.lockutils [None req-3e7c4441-5a95-4d3f-b948-a7b1a53ec00e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:26:35.006606 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_concurrency.lockutils [None req-3e7c4441-5a95-4d3f-b948-a7b1a53ec00e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:26:35.007469 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_concurrency.lockutils [None req-3e7c4441-5a95-4d3f-b948-a7b1a53ec00e admin admin] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:26:35.007901 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_concurrency.lockutils [None req-3e7c4441-5a95-4d3f-b948-a7b1a53ec00e admin admin] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:26:35.026627 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-3e7c4441-5a95-4d3f-b948-a7b1a53ec00e admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077292 Nov 16 00:26:35.027226 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 36/73] 10.222.0.31 () {60 vars in 1193 bytes} [Tue Nov 16 00:26:34 2021] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:26:46.862034 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-c62b34a9-3506-42f6-8756-8e345dc1a65c admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:26:46.863040 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-c62b34a9-3506-42f6-8756-8e345dc1a65c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Nov 16 00:26:46.863462 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 38/74] 10.222.0.31 () {56 vars in 1074 bytes} [Tue Nov 16 00:26:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:26:47.057758 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-a353e587-4fac-4ad3-9603-3fd593d7039e admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:26:47.059035 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:26:47.059035 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: warnings.warn(msg) Nov 16 00:26:47.060840 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_concurrency.lockutils [None req-a353e587-4fac-4ad3-9603-3fd593d7039e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:26:47.061343 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_concurrency.lockutils [None req-a353e587-4fac-4ad3-9603-3fd593d7039e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:26:47.062064 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_concurrency.lockutils [None req-a353e587-4fac-4ad3-9603-3fd593d7039e admin admin] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:26:47.062486 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_concurrency.lockutils [None req-a353e587-4fac-4ad3-9603-3fd593d7039e admin admin] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:26:47.088583 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-a353e587-4fac-4ad3-9603-3fd593d7039e admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085675 Nov 16 00:26:47.089480 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 37/75] 10.222.0.31 () {60 vars in 1193 bytes} [Tue Nov 16 00:26:47 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:26:48.470329 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: DEBUG nova.api.openstack.wsgi [None req-c62b34a9-3506-42f6-8756-8e345dc1a65c admin admin] Calling method '>' {{(pid=107128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:26:48.471368 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: INFO nova.api.openstack.requestlog [None req-c62b34a9-3506-42f6-8756-8e345dc1a65c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Nov 16 00:26:48.471766 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: [pid: 107128|app: 0|req: 39/76] 10.222.0.31 () {56 vars in 1074 bytes} [Tue Nov 16 00:26:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:26:48.663493 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG nova.api.openstack.wsgi [None req-4aeadc29-c19d-4e90-ac1d-e3d9e9e22fc2 admin admin] Calling method '>' {{(pid=107127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:26:48.665042 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:26:48.665042 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: warnings.warn(msg) Nov 16 00:26:48.666623 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_concurrency.lockutils [None req-4aeadc29-c19d-4e90-ac1d-e3d9e9e22fc2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:26:48.667104 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_concurrency.lockutils [None req-4aeadc29-c19d-4e90-ac1d-e3d9e9e22fc2 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:26:48.668171 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_concurrency.lockutils [None req-4aeadc29-c19d-4e90-ac1d-e3d9e9e22fc2 admin admin] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:26:48.668596 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: DEBUG oslo_concurrency.lockutils [None req-4aeadc29-c19d-4e90-ac1d-e3d9e9e22fc2 admin admin] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:26:48.690354 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: INFO nova.api.openstack.requestlog [None req-4aeadc29-c19d-4e90-ac1d-e3d9e9e22fc2 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078739 Nov 16 00:26:48.690832 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: [pid: 107127|app: 0|req: 38/77] 10.222.0.31 () {60 vars in 1193 bytes} [Tue Nov 16 00:26:48 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:27:44.609979 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: Tue Nov 16 00:27:44 2021 - graceful shutdown triggered... Nov 16 00:27:44.609695 dv-cinder-811154-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 16 00:27:44.610972 dv-cinder-811154-2-iscsi devstack@n-api.service[107127]: Gracefully killing worker 1 (pid: 107127)... Nov 16 00:27:44.611681 dv-cinder-811154-2-iscsi devstack@n-api.service[107128]: Gracefully killing worker 2 (pid: 107128)... Nov 16 00:27:45.610766 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: worker 1 buried after 1 seconds Nov 16 00:27:45.610766 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: worker 2 buried after 1 seconds Nov 16 00:27:45.610766 dv-cinder-811154-2-iscsi devstack@n-api.service[107126]: goodbye to uWSGI. Nov 16 00:27:45.612313 dv-cinder-811154-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 16 00:27:45.612905 dv-cinder-811154-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 16 00:27:45.615757 dv-cinder-811154-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 16 00:27:45.625928 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 16 00:27:45.628058 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 16 00:27:45 2021] *** Nov 16 00:27:45.628058 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 16 00:27:45.628058 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 16 00:27:45.628058 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: nodename: dv-cinder-811154-2-iscsi Nov 16 00:27:45.628058 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: machine: x86_64 Nov 16 00:27:45.628058 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: clock source: unix Nov 16 00:27:45.628058 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: pcre jit disabled Nov 16 00:27:45.628058 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: detected number of CPU cores: 4 Nov 16 00:27:45.628058 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: current working directory: / Nov 16 00:27:45.628058 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: detected binary path: /usr/bin/uwsgi-core Nov 16 00:27:45.628757 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: your processes number limit is 47680 Nov 16 00:27:45.628757 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: your memory page size is 4096 bytes Nov 16 00:27:45.628757 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: detected max file descriptor number: 2048 Nov 16 00:27:45.628757 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: lock engine: pthread robust mutexes Nov 16 00:27:45.628757 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: thunder lock: enabled Nov 16 00:27:45.628757 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 16 00:27:45.628757 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 16 00:27:45.674103 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: Python main interpreter initialized at 0x55abc34139c0 Nov 16 00:27:45.674103 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: python threads support enabled Nov 16 00:27:45.674103 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: your server socket listen backlog is limited to 100 connections Nov 16 00:27:45.674103 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: your mercy for graceful operations on workers is 90 seconds Nov 16 00:27:45.674542 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: mapped 403077 bytes (393 KB) for 2 cores Nov 16 00:27:45.674542 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: *** Operational MODE: preforking *** Nov 16 00:27:45.674843 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: *** uWSGI is running in multiple interpreter mode *** Nov 16 00:27:45.674843 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: spawned uWSGI master process (pid: 122532) Nov 16 00:27:45.675087 dv-cinder-811154-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 16 00:27:45.676326 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: spawned uWSGI worker 1 (pid: 122543, cores: 1) Nov 16 00:27:45.676326 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: spawned uWSGI worker 2 (pid: 122544, cores: 1) Nov 16 00:27:45.676326 dv-cinder-811154-2-iscsi devstack@n-api.service[122532]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 16 00:27:47.498669 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 00:27:47.498669 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: from cryptography.utils import int_from_bytes Nov 16 00:27:47.499411 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 00:27:47.499411 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: from cryptography.utils import int_from_bytes Nov 16 00:27:47.517337 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 00:27:47.517337 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: from cryptography.utils import int_from_bytes Nov 16 00:27:47.517979 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 00:27:47.517979 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: from cryptography.utils import int_from_bytes Nov 16 00:27:50.170084 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 00:27:50.170645 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 00:27:50.170753 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 00:27:50.171153 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 00:27:50.171242 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 00:27:50.171324 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 00:27:50.171409 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 00:27:50.171487 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 00:27:50.171800 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.171908 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 00:27:50.172048 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 00:27:50.172150 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.172427 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.172530 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.172744 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.172846 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.173079 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.173189 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.173372 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.173480 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.173692 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.173785 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.173994 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.174098 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.174309 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.174401 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.174573 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.174671 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.174890 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.174993 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.175193 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.175293 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-811154-2-iscsi {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.175504 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.175607 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.175824 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-811154-2-iscsi {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.175930 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.176136 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.176237 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.176439 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.176538 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.176745 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.176845 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.177060 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.177152 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.177366 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.177558 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.177711 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.177964 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.178090 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.179253 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.179434 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.179626 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.179763 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.179897 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.180044 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.180044 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.180305 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.180519 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.180668 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.180794 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.180932 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.181053 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.181192 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.181330 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.181469 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.181599 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.181743 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.181880 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.182026 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.182158 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.182295 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-811154-2-iscsi {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.182436 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-811154-2-iscsi {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.182580 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.182711 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.182839 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.182976 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.183131 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.183279 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.183418 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.183538 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.183675 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.183858 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.183990 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.184127 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.184258 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.184394 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.184532 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.184749 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.184894 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.185039 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.185176 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.185309 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.185446 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.185587 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.185724 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.185880 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.186078 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.186212 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.186353 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.186495 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.186626 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.186765 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.186896 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.187026 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.187186 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.187320 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.187477 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.187681 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.187821 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.187963 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.188094 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.188231 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.188388 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.188526 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.188656 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.188795 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.188932 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.189068 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.189211 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.189352 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.189492 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.189632 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.189763 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.189920 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.190062 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.190208 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.190347 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.190488 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.190628 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.190758 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.190887 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.191028 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.191192 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.191322 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.191464 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.191606 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.191744 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.191884 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.192015 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.192152 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.192295 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.192432 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.192571 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.192708 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.192891 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.193033 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.193726 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.193931 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.194153 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.194374 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.194563 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.194726 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.194928 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.195097 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.195246 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.195386 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.195517 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.195729 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.195872 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.196011 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.196481 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.196621 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.196766 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.196915 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.197057 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.197195 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.197326 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.197455 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.197596 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.197819 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.197964 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.197964 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.198221 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.198358 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.198502 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.198640 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.198769 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.198900 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.199030 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.199218 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.199369 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.199511 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.199642 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.199778 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.199909 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.200045 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.200184 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.200315 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.200444 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.200581 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.200712 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.200712 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.200986 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.201125 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.201256 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.201394 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.201535 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.201682 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.201821 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.201958 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.202089 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.202219 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.202356 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.202496 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.202634 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.202773 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.202903 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.203040 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.203188 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.203331 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.203462 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.203602 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.203743 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.203880 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.204010 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.204150 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.204290 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.204468 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.204611 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.204792 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.204950 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.205156 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.205292 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.205423 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.205567 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.205698 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.205843 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.205975 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.206113 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.206275 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.206479 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.206613 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.206758 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.206897 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.207040 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.207219 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.207350 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.207481 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.207621 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.207854 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.208005 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.208145 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.208275 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.208420 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.208559 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.208696 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.208947 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.209635 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.209868 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.210104 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.210277 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.210421 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.210561 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.210699 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.210837 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.210977 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.211130 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.211288 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.211423 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.211553 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.211691 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.211830 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.211960 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.212090 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.212219 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.212355 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.212500 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.212639 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.212778 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.212909 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.213045 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.213181 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.213321 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.213458 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.213629 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.213762 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.213931 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.214080 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.214218 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.214346 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.214529 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.214673 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.214843 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.214990 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.215186 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 00:27:50.215399 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.215542 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.215681 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.215822 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.216037 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.216188 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.216321 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.216473 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.216672 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.216820 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.216952 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.217089 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.217229 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.217360 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.217489 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.217630 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.217876 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.218098 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.218240 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.218371 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.218509 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.218651 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.218791 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.218928 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.219129 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.219266 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.219454 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.219599 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.219767 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.219903 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.220081 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.220229 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.220395 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.220529 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.220702 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.220849 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.221020 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.221162 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.221339 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.221488 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.221654 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.221786 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.221960 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.222094 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.222289 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.222431 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.222618 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.222765 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.222924 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.223114 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.223261 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.223407 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.223545 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.223677 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.223868 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.224012 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.224176 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.224328 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.224494 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.224670 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.224887 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.225144 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.225324 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.225546 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.225681 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.225812 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.225941 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.226071 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.226211 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.226342 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.226480 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.226618 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.226844 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.227069 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.227223 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.227355 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.227548 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.227854 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.228156 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.228471 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.228796 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.229100 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.229429 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.229732 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.230038 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.230344 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.230645 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.230953 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.231287 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.231435 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.231589 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.231737 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.231908 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.232043 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.232212 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.232346 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.232511 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.232655 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.232991 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.233137 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.233285 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.233560 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.233771 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.234024 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.234165 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.234368 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.234822 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.235092 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.235433 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.235718 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.235915 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.236199 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.236500 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.236660 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.237010 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.237010 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.237010 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.237010 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.237010 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.237010 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.237010 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.238216 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.238216 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.238216 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.238216 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.239203 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.239203 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.239203 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.239598 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.239739 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.239739 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.240000 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.240169 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.240347 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.240551 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.240768 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.240991 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.241148 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.241282 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.241414 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.241550 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.241689 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.241822 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.241822 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.242086 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.242225 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.242362 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.242493 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.242623 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.242762 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.242895 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.243025 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.243190 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.243322 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.243609 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.243929 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.244238 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.244551 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.244859 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.245166 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.245472 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.245781 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.246094 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.246401 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.246715 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.247030 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.247181 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.247366 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.247517 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.247672 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.247856 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.247989 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.248173 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.248292 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.248520 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.248611 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.248858 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.248972 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.249177 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.249270 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.249528 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.249618 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.249841 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.249944 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.250148 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.250238 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.250456 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.250559 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.250761 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.250861 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.251087 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.251412 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.251706 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.252018 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.252326 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.252640 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.252944 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.253262 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.253571 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.253880 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.254178 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.254288 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.254486 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.254631 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.254811 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.254946 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.255162 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.255308 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.255467 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.255604 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.256385 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.256607 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.256849 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.257008 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.257158 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.257358 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.257500 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.257649 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.257790 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.257921 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.258051 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.258181 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.258311 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.258441 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.258596 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.258795 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.258930 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.259086 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.259233 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.259380 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.259522 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.259655 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.259831 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.259967 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.260145 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.260291 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.260474 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.260609 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.260774 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.260910 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.261087 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.261231 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.261406 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.261561 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.261779 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.261914 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.262045 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.262185 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.262318 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.262448 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.262608 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.262748 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.262896 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.263027 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.263237 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.263386 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.263546 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.263689 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.263835 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.263967 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.264134 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.264268 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.264435 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.264570 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.264777 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.264922 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.265083 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.265218 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.265383 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.265518 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.265695 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.265839 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.266013 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.266148 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.266321 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.266443 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.266637 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.266741 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.266943 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.267070 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.267271 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.267387 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.267588 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.267691 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.267898 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.267999 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.268204 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.268305 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.268513 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.268611 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.268818 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.268908 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.269125 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.269226 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.269430 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.269528 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.269748 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.269839 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.270053 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.270154 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.270360 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.270450 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.270663 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.270754 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.270963 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.271080 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.271319 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.271455 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.272187 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.272478 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.272730 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.272835 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.273064 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.273169 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.273396 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.273488 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.273714 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.273807 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.274035 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.274133 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.274350 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.274449 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.274668 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.274766 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.274982 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.275095 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.275347 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.275536 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.275702 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.275853 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.276000 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.276154 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.276300 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.276480 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.276703 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.276852 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.277008 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.277162 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.277315 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.277504 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.277730 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.277881 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.278026 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.278178 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.278331 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.278489 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.278644 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.278788 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.279040 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.279246 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.279404 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.279551 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.279706 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.279858 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.280004 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.280156 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.280313 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.280458 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.280603 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.280755 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.280910 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.281067 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.281212 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.281355 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.281586 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.281749 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.281904 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.282061 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.282362 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.282522 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.282677 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.282838 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.282985 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.283175 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.283342 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.283488 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.283632 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.283787 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.283933 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.284086 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.284231 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.284375 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.284527 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.284681 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.284835 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.284990 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.285135 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.285297 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.285457 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.285602 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.285745 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.285899 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.286053 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.286198 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.286355 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.286355 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.286639 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.286847 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.287107 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.287369 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.287622 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.288045 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.288302 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.288555 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.288796 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.289081 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.289437 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.289678 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.289932 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.290185 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.290418 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.290673 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.290931 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.291223 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.291735 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.291984 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.292235 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.292614 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.292874 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.293103 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.293260 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.293409 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.293563 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.293724 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.293724 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.294022 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.294168 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.294321 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.294475 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.294634 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.294780 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.294932 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.295113 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.295276 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.295439 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.295439 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.295714 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.295871 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.296015 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.296159 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.296318 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.296473 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.296618 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.296762 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.296913 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.297067 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.297226 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.297373 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.297517 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.297669 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.297832 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.298079 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.298247 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.298396 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.298541 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.298695 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.298928 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.299125 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.299279 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.299511 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.299664 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.299817 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.299969 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.300136 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.300283 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.300436 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.300583 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.300727 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.300879 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.301039 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.301199 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.301345 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.301489 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.301648 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.301794 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.301952 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.302115 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.302270 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.302425 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.302699 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.302955 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.303284 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.303442 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.303604 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.303767 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.303913 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.304058 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.304211 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.304211 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.304509 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.304670 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.304817 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.304961 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.305105 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.305249 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.305403 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.305548 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.305692 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.305846 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.305998 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.306151 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.306316 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.306462 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.306606 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.306758 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.306905 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.307086 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.307259 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.307414 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.307560 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.307560 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.307834 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.307981 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.308224 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.308387 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.308534 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.308678 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.308860 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.309020 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.309181 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.309328 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.309489 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.309707 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.309855 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.310089 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.310245 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.310390 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.310545 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.310698 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.310842 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.310995 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.311157 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.311271 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.311361 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.311444 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.311535 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.311634 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.311726 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.311809 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.311934 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.312035 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.312127 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.312244 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.312331 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.312430 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.312519 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.312592 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.312674 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.312765 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.312843 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.312928 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.313005 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.313075 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.313152 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.313230 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.313307 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.313408 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.313489 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.313566 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.313654 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.313732 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.313810 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.313888 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.313957 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.314026 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.314102 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.314179 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.314249 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.314324 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.314393 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.314471 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.314549 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.314620 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.314695 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.314772 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.314850 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.314928 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.315022 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.315136 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.315218 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.315297 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.315367 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.315445 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.315609 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.315740 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.315877 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.315969 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.316121 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.316277 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.316411 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.316498 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.316627 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.316714 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.316855 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.316952 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.317036 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.317173 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.317269 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.317409 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.317511 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.317596 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.317733 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.317821 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.317950 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.318045 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.318729 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.318877 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.318971 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.319082 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.319180 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.319264 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.319264 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.319436 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.319519 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.319882 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.319984 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.320184 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.320281 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.320507 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.320656 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.320820 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.320920 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.321137 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.321237 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.321440 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.321532 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.321759 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.321851 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.322089 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.322227 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.322389 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.322480 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.322704 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.322795 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.323023 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.323187 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.323356 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.323498 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.323651 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.323808 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.323978 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.324128 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.324293 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.324448 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.324609 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.324770 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.324934 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.325074 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.325260 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.325388 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.325589 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.325699 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.325903 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.326040 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.326217 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.326316 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.326529 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.326636 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.326839 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.326939 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.327177 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.327271 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.327491 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.327583 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.327806 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.327902 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.328124 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.328213 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.328439 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.328539 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.328787 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.328978 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.329067 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.329157 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.329366 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.329459 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.329678 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.329768 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.329992 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.330091 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.330302 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.330394 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.330630 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.330719 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.330939 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.331040 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.331265 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.331364 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.331571 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.331662 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.331875 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.331979 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.332185 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.332274 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.332491 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.332579 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.332800 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.332950 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.333107 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.333269 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.333406 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.333537 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.333706 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.333849 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.334664 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.334764 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.334967 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.335142 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.335319 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.335455 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.335636 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.335788 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.335954 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.336101 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.336276 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.336529 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.336623 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.336847 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.336947 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.337166 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.337267 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.337463 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.337552 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.337766 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.337864 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.338067 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.338166 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.338384 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.338481 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.338696 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.338786 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.339012 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.339166 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.339348 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.339443 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.339657 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.339761 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.339963 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.340100 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.340286 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.340384 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.340610 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.340711 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.340926 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.341016 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.341239 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.341338 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.341559 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.341658 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.341860 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.342039 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.342162 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.342359 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.342463 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.342678 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.342776 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.343008 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.343122 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.343364 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.343475 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.343669 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.343768 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.343968 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.344069 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.344267 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.344360 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.344565 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.344655 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.344886 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.344976 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.345190 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.345281 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.345509 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.345609 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.345818 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.345916 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.346121 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.346258 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.346425 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.346562 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.346726 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.346827 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.347087 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.347184 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.347395 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.347497 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.347728 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.347833 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.348050 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.348142 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.348372 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.348463 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.348697 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.348797 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.349005 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.349141 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.349327 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.349439 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.349687 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.349859 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.350002 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.350233 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.350381 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.350546 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.350638 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.350861 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.350954 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.351219 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.351312 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.351533 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.351642 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.351849 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.351940 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.352163 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.352253 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.352474 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.352577 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.352780 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.352870 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.353088 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.353315 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.353413 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.353642 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.353735 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.353955 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.354047 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.354265 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.354356 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.354576 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.354668 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.354886 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.354986 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.355220 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.355327 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.355529 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.355669 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.355838 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.355930 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.356145 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.356246 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.356452 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.356555 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.356778 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.356882 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.357096 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.357265 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.357418 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.357516 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.357743 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.357840 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.358059 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.358152 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.358374 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.358464 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.358688 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.358786 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.359003 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.359133 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.359367 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.359472 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.359690 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.359782 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.359992 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.360091 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.360310 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.360447 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.360617 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.360717 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.360925 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.361024 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.361230 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.361318 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.361534 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.361631 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.361843 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.361943 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.362151 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.362242 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.362458 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.362556 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.362762 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.362850 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.363079 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.363175 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.363390 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.363483 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.363709 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.363799 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.364019 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.364116 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.364340 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.364437 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.364652 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.364750 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.364957 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.365584 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.365805 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.365953 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.366086 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.366284 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.366600 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.366710 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.366920 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.367024 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.367266 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.367370 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.367589 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.367691 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.367904 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.368002 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.368218 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.368310 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.368541 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.368644 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.368841 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.368932 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.369145 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.369235 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.369453 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.369562 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.369759 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.369852 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.370060 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.370152 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.370381 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.370524 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.370688 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.370787 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.370989 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.371124 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.371331 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.371431 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.371639 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.371738 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.371956 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.372167 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.372272 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.372514 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.372802 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.372894 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.373135 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.373276 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.373454 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.373605 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.373769 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.373868 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.374074 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.374217 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.374390 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.374480 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.374691 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.374780 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.374995 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.375126 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.375329 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.375421 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.375635 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.375725 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.375953 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.376099 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.376237 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.376328 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.376555 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.376761 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.376858 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.376969 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.377138 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.377251 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.377443 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.377534 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.377743 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.377843 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.378065 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.378164 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.378368 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.378460 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.378668 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.378807 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.378968 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.379152 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.379298 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.379466 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.379599 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.379789 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.379883 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.380112 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.380203 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.380435 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.380535 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.381361 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.381483 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.381690 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.381831 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.382110 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.382202 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.382421 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.382590 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.382737 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.382830 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.383076 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.383674 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.383674 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.383863 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.383956 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.384055 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.384147 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.384232 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.384362 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.384486 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.384688 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.384793 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.385012 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.385103 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.385335 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.385427 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.385658 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.385760 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.385999 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.386187 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.386310 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.386514 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.386655 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.386854 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.386969 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.387218 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.387536 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.387659 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.387861 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.387977 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.388181 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.388284 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.390107 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.390270 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.390407 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.391184 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.391280 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.391355 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.391436 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.391518 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.391602 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.391675 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.391745 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.391815 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.391893 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.392061 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.392145 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.392218 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.392288 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.392365 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.392437 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.392515 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.392595 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.392667 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.392667 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.392804 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.392874 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.392957 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.393036 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.393115 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.393193 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.393265 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.393361 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.393517 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.393600 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.393696 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.393771 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.393975 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.394082 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.394318 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.394423 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.394617 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.394725 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.394921 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.395073 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.395269 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.395586 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.395801 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.395900 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.396197 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.397030 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.397163 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.397349 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.397664 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.397798 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.397978 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.398088 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.398285 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.398389 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.398618 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.398718 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.398918 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.399160 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.399255 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.399477 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.399594 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.399803 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.399916 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.400130 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.400232 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.400443 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.400545 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.400763 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.400867 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.401059 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.401161 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.401428 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.401533 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.401724 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.401826 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.402024 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.402120 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.402301 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.402396 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.402584 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.402687 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.402896 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.402996 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.403254 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.403354 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.403556 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.403653 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.403867 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.403982 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.404214 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.404319 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.404574 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.404687 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.404847 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.404938 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.405107 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.405241 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.405428 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.405529 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.405737 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.405842 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.406051 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.406154 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.406357 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.406448 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.406678 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.406779 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.406997 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.407291 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.407387 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.407638 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.407739 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.407968 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.408082 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.408279 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.408381 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.408591 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.408723 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.408899 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.409041 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.409213 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.409350 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.409519 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.409661 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.409828 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.409975 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.410154 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.410289 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.410477 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.410605 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.410782 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.410923 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.411127 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.411275 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.411444 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.411592 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.411764 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.411925 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.412353 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.412462 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.412575 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.412667 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.412908 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.413001 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.413216 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.413306 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.413530 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.413665 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.413838 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.413934 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.414146 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.414237 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.414974 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.415112 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.415285 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.415377 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.415610 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.415700 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.415933 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.416034 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.416255 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.416346 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.416847 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.416949 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.417184 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.417289 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.417494 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.417588 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.417804 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.417909 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.418148 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.418239 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.418389 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 00:27:50.418539 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.418865 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.419215 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.419533 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.419882 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.420187 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.420502 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.420828 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.421141 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.421476 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.421826 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.422162 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.422493 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.422802 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.423132 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.423443 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.423758 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.424098 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.424418 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.424746 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.425069 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.425394 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.425711 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.426039 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.426373 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.426701 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.427017 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.427379 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.427854 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.428276 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.428604 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.428918 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.429235 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.429551 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.429886 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.430218 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.430530 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.430866 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.431208 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.431539 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.431861 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.432176 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.432509 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.432824 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.433144 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.433458 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.433773 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.434093 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.434413 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.434743 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.435093 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.435429 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.436133 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.436495 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.436830 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.437171 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.437503 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 00:27:50.437754 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 00:27:50.440727 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_db.sqlalchemy.engines [None req-4cbd2622-243c-4f9b-933f-9a2731bca99d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 00:27:50.460024 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_db.sqlalchemy.engines [None req-b4c91b7a-bf0f-4039-8e6a-4ba7861eca53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 00:27:50.519613 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.context [None req-4cbd2622-243c-4f9b-933f-9a2731bca99d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e9e03b1-3ea8-4563-a932-133fe83355c3(cell1) {{(pid=122544) load_cells /opt/stack/nova/nova/context.py:464}} Nov 16 00:27:50.524547 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4cbd2622-243c-4f9b-933f-9a2731bca99d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:27:50.526119 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4cbd2622-243c-4f9b-933f-9a2731bca99d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:27:50.526919 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4cbd2622-243c-4f9b-933f-9a2731bca99d None None] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:27:50.528888 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4cbd2622-243c-4f9b-933f-9a2731bca99d None None] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:27:50.540255 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_db.sqlalchemy.engines [None req-4cbd2622-243c-4f9b-933f-9a2731bca99d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 00:27:50.540757 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.context [None req-b4c91b7a-bf0f-4039-8e6a-4ba7861eca53 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9e9e03b1-3ea8-4563-a932-133fe83355c3(cell1) {{(pid=122543) load_cells /opt/stack/nova/nova/context.py:464}} Nov 16 00:27:50.542561 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_db.sqlalchemy.engines [None req-4cbd2622-243c-4f9b-933f-9a2731bca99d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 00:27:50.545614 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b4c91b7a-bf0f-4039-8e6a-4ba7861eca53 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:27:50.547260 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b4c91b7a-bf0f-4039-8e6a-4ba7861eca53 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:27:50.548099 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b4c91b7a-bf0f-4039-8e6a-4ba7861eca53 None None] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:27:50.550087 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b4c91b7a-bf0f-4039-8e6a-4ba7861eca53 None None] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:27:50.561983 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_db.sqlalchemy.engines [None req-b4c91b7a-bf0f-4039-8e6a-4ba7861eca53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 00:27:50.563343 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_db.sqlalchemy.engines [None req-b4c91b7a-bf0f-4039-8e6a-4ba7861eca53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 00:27:50.806309 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_db.sqlalchemy.engines [None req-4cbd2622-243c-4f9b-933f-9a2731bca99d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 00:27:50.832439 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_db.sqlalchemy.engines [None req-b4c91b7a-bf0f-4039-8e6a-4ba7861eca53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 00:27:51.141319 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: WARNING keystonemiddleware.auth_token [None req-4cbd2622-243c-4f9b-933f-9a2731bca99d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 00:27:51.148098 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: WARNING keystonemiddleware.auth_token [None req-4cbd2622-243c-4f9b-933f-9a2731bca99d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 00:27:51.167329 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: WARNING keystonemiddleware.auth_token [None req-b4c91b7a-bf0f-4039-8e6a-4ba7861eca53 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 00:27:51.174056 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: WARNING keystonemiddleware.auth_token [None req-b4c91b7a-bf0f-4039-8e6a-4ba7861eca53 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 00:27:51.501475 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: WARNING keystonemiddleware.auth_token [None req-4cbd2622-243c-4f9b-933f-9a2731bca99d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 00:27:51.507389 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: WARNING keystonemiddleware.auth_token [None req-4cbd2622-243c-4f9b-933f-9a2731bca99d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 00:27:51.513360 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55abc34139c0 pid: 122544 (default app) Nov 16 00:27:51.525484 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: WARNING keystonemiddleware.auth_token [None req-b4c91b7a-bf0f-4039-8e6a-4ba7861eca53 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 00:27:51.530869 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: WARNING keystonemiddleware.auth_token [None req-b4c91b7a-bf0f-4039-8e6a-4ba7861eca53 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 00:27:51.536161 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55abc34139c0 pid: 122543 (default app) Nov 16 00:28:33.926594 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-c872f803-193c-443e-9e9b-b8730ba0ea0c tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Action: 'create', calling method: .version_select at 0x7f2f2b489940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1461195181"}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:28:34.565748 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-89d53a3c-d2a9-4b38-bd96-9920877997e5 tempest-VolumesGetTestJSON-1425853663 tempest-VolumesGetTestJSON-1425853663-project] Action: 'create', calling method: .version_select at 0x7f2f2b48a940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-414450108", "metadata": {"Type": "work"}}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:28:35.930146 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-c872f803-193c-443e-9e9b-b8730ba0ea0c tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.211681 Nov 16 00:28:35.932539 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 1/1] 10.222.0.31 () {60 vars in 1154 bytes} [Tue Nov 16 00:28:32 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3216 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 16 00:28:35.979214 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-89d53a3c-d2a9-4b38-bd96-9920877997e5 tempest-VolumesGetTestJSON-1425853663 tempest-VolumesGetTestJSON-1425853663-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.755590 Nov 16 00:28:35.979853 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 1/2] 10.222.0.31 () {60 vars in 1155 bytes} [Tue Nov 16 00:28:33 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 2758 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 16 00:28:35.986075 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-770e6f11-4a2b-4bd6-a8be-9d6834f61059 tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Calling method '.version_select at 0x7f2f2b3544c0>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:36.078487 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-770e6f11-4a2b-4bd6-a8be-9d6834f61059 tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/9c059573-4b12-462f-848b-00ddd13ffd7a" status: 200 len: 345 microversion: 2.1 time: 0.097453 Nov 16 00:28:36.079632 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 2/3] 10.222.0.31 () {58 vars in 1244 bytes} [Tue Nov 16 00:28:35 2021] GET /compute/v2.1/os-volumes/9c059573-4b12-462f-848b-00ddd13ffd7a => generated 345 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:28:36.085552 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-868a7f5b-05c5-4d7d-b409-8b11a778d0e4 tempest-VolumesGetTestJSON-1425853663 tempest-VolumesGetTestJSON-1425853663-project] Calling method '.version_select at 0x7f2f2b354ca0>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:36.159282 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-868a7f5b-05c5-4d7d-b409-8b11a778d0e4 tempest-VolumesGetTestJSON-1425853663 tempest-VolumesGetTestJSON-1425853663-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/20cf53f5-8e19-4822-920d-463b58573677" status: 200 len: 352 microversion: 2.1 time: 0.078274 Nov 16 00:28:36.159845 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 3/4] 10.222.0.31 () {58 vars in 1244 bytes} [Tue Nov 16 00:28:36 2021] GET /compute/v2.1/os-volumes/20cf53f5-8e19-4822-920d-463b58573677 => generated 352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:28:36.319451 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-15281b75-6a06-499f-99a0-ee6fdc8257e3 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1097033268", "imageRef": "bb47ca05-3b48-4f1c-bc96-e0c5c672caba", "flavorRef": "452", "networks": [{"uuid": "4e083894-713d-40ec-82b0-770ac030fcb9"}]}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:28:36.538475 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.network.neutron [None req-15281b75-6a06-499f-99a0-ee6fdc8257e3 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] validate_networks() for [('4e083894-713d-40ec-82b0-770ac030fcb9', None, None, None, None, None)] {{(pid=122544) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:28:37.091816 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-029fb2e5-340f-4d3a-a77e-a4b6063c5935 tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Calling method '.version_select at 0x7f2f2b354e50>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:37.155545 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-029fb2e5-340f-4d3a-a77e-a4b6063c5935 tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/9c059573-4b12-462f-848b-00ddd13ffd7a" status: 200 len: 346 microversion: 2.1 time: 0.067276 Nov 16 00:28:37.162635 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 4/5] 10.222.0.31 () {58 vars in 1244 bytes} [Tue Nov 16 00:28:37 2021] GET /compute/v2.1/os-volumes/9c059573-4b12-462f-848b-00ddd13ffd7a => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:28:37.168694 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-d492a242-abb9-40b4-a316-72c1ed1bbd6c tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Action: 'create', calling method: .version_select at 0x7f2f2b36b820>, body: {"snapshot": {"volume_id": "9c059573-4b12-462f-848b-00ddd13ffd7a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-157412311"}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:28:37.670534 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-d492a242-abb9-40b4-a316-72c1ed1bbd6c tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] 10.222.0.31 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.479665 Nov 16 00:28:37.670534 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 5/6] 10.222.0.31 () {60 vars in 1161 bytes} [Tue Nov 16 00:28:37 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:28:37.672407 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-51d4f9fd-3de6-4d66-88cc-6ea5dda61bc8 tempest-VolumesGetTestJSON-1425853663 tempest-VolumesGetTestJSON-1425853663-project] Calling method '.version_select at 0x7f2f2b36be50>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:37.788306 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-51d4f9fd-3de6-4d66-88cc-6ea5dda61bc8 tempest-VolumesGetTestJSON-1425853663 tempest-VolumesGetTestJSON-1425853663-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/20cf53f5-8e19-4822-920d-463b58573677" status: 200 len: 353 microversion: 2.1 time: 0.126334 Nov 16 00:28:37.789175 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 6/7] 10.222.0.31 () {58 vars in 1244 bytes} [Tue Nov 16 00:28:37 2021] GET /compute/v2.1/os-volumes/20cf53f5-8e19-4822-920d-463b58573677 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:28:37.804046 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-d751c2f4-409d-4a79-b703-85f1ed1378ab tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Calling method '.version_select at 0x7f2f2b36b550>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:37.850142 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-d751c2f4-409d-4a79-b703-85f1ed1378ab tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/715d3db0-c664-493c-8111-446b627c7cf3" status: 200 len: 286 microversion: 2.1 time: 0.057967 Nov 16 00:28:37.851404 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 7/8] 10.222.0.31 () {58 vars in 1250 bytes} [Tue Nov 16 00:28:37 2021] GET /compute/v2.1/os-snapshots/715d3db0-c664-493c-8111-446b627c7cf3 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:28:37.858029 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-73f42769-293b-43ed-ba5a-f01f20c161fc tempest-VolumesGetTestJSON-1425853663 tempest-VolumesGetTestJSON-1425853663-project] Calling method '.version_select at 0x7f2f2b354700>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:37.988098 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-73f42769-293b-43ed-ba5a-f01f20c161fc tempest-VolumesGetTestJSON-1425853663 tempest-VolumesGetTestJSON-1425853663-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/20cf53f5-8e19-4822-920d-463b58573677" status: 200 len: 353 microversion: 2.1 time: 0.135370 Nov 16 00:28:37.989264 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 8/9] 10.222.0.31 () {58 vars in 1244 bytes} [Tue Nov 16 00:28:37 2021] GET /compute/v2.1/os-volumes/20cf53f5-8e19-4822-920d-463b58573677 => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:28:37.998797 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-9281eed7-a329-4c25-86e5-3086fbb391ad tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Calling method '.version_select at 0x7f2f2b354ca0>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:38.064965 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-9281eed7-a329-4c25-86e5-3086fbb391ad tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.074467 Nov 16 00:28:38.068942 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 9/10] 10.222.0.31 () {58 vars in 1139 bytes} [Tue Nov 16 00:28:37 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:28:38.073995 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ab39315e-a1f0-4435-903b-767a05a0d075 tempest-VolumesGetTestJSON-1425853663 tempest-VolumesGetTestJSON-1425853663-project] Calling method '.version_select at 0x7f2f2b36b4c0>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:38.259587 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ab39315e-a1f0-4435-903b-767a05a0d075 tempest-VolumesGetTestJSON-1425853663 tempest-VolumesGetTestJSON-1425853663-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/20cf53f5-8e19-4822-920d-463b58573677" status: 202 len: 0 microversion: 2.1 time: 0.189474 Nov 16 00:28:38.260528 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 10/11] 10.222.0.31 () {58 vars in 1247 bytes} [Tue Nov 16 00:28:38 2021] DELETE /compute/v2.1/os-volumes/20cf53f5-8e19-4822-920d-463b58573677 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:28:38.267521 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-b1bd36c5-c3b4-4d7f-a67f-6fdc44ab606e tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Calling method '.version_select at 0x7f2f2b36bdc0>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:38.340448 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-b1bd36c5-c3b4-4d7f-a67f-6fdc44ab606e tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/715d3db0-c664-493c-8111-446b627c7cf3" status: 200 len: 286 microversion: 2.1 time: 0.078752 Nov 16 00:28:38.341508 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 11/12] 10.222.0.31 () {58 vars in 1250 bytes} [Tue Nov 16 00:28:38 2021] GET /compute/v2.1/os-snapshots/715d3db0-c664-493c-8111-446b627c7cf3 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:28:38.350575 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-b99df53a-57c7-4f1f-a0cf-9c0669294acc tempest-VolumesGetTestJSON-1425853663 tempest-VolumesGetTestJSON-1425853663-project] Calling method '.version_select at 0x7f2f2b36bf70>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:38.357809 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-15281b75-6a06-499f-99a0-ee6fdc8257e3 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Flavor limits 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:28:38.358353 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-15281b75-6a06-499f-99a0-ee6fdc8257e3 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Image limits 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:28:38.358758 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-15281b75-6a06-499f-99a0-ee6fdc8257e3 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Flavor pref 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:28:38.359333 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-15281b75-6a06-499f-99a0-ee6fdc8257e3 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Image pref 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:28:38.360649 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-15281b75-6a06-499f-99a0-ee6fdc8257e3 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:28:38.388957 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-15281b75-6a06-499f-99a0-ee6fdc8257e3 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:38.389710 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-15281b75-6a06-499f-99a0-ee6fdc8257e3 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:38.390685 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-15281b75-6a06-499f-99a0-ee6fdc8257e3 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:38.391689 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-15281b75-6a06-499f-99a0-ee6fdc8257e3 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:38.439737 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-15281b75-6a06-499f-99a0-ee6fdc8257e3 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Getting quotas for project 273835248c36490c9fc2db9b2a651333. Resources: {'instances', 'cores', 'ram'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:28:38.450333 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-15281b75-6a06-499f-99a0-ee6fdc8257e3 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Getting quotas for user 464dae8aa1f24b939735e0735fba0904 and project 273835248c36490c9fc2db9b2a651333. Resources: {'instances', 'cores', 'ram'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:28:38.475210 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-15281b75-6a06-499f-99a0-ee6fdc8257e3 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Going to run 1 instances... {{(pid=122544) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:28:38.480716 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-15281b75-6a06-499f-99a0-ee6fdc8257e3 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb47ca05-3b48-4f1c-bc96-e0c5c672caba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:28:38.518892 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-b99df53a-57c7-4f1f-a0cf-9c0669294acc tempest-VolumesGetTestJSON-1425853663 tempest-VolumesGetTestJSON-1425853663-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/20cf53f5-8e19-4822-920d-463b58573677" status: 200 len: 352 microversion: 2.1 time: 0.176246 Nov 16 00:28:38.519481 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 12/13] 10.222.0.31 () {58 vars in 1244 bytes} [Tue Nov 16 00:28:38 2021] GET /compute/v2.1/os-volumes/20cf53f5-8e19-4822-920d-463b58573677 => generated 352 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:28:38.682826 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-15281b75-6a06-499f-99a0-ee6fdc8257e3 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.748614 Nov 16 00:28:38.692110 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 2/14] 10.222.0.31 () {60 vars in 1146 bytes} [Tue Nov 16 00:28:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 2759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 00:28:38.701981 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-56d8bb19-765b-4855-a6c6-771b424b79b1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:38.702996 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-56d8bb19-765b-4855-a6c6-771b424b79b1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:28:38.984831 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-56d8bb19-765b-4855-a6c6-771b424b79b1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:28:39.020598 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-56d8bb19-765b-4855-a6c6-771b424b79b1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1215 microversion: 2.1 time: 0.322134 Nov 16 00:28:39.030821 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 13/15] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:28:38 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1215 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:28:39.355652 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e440fdc5-1580-4c32-b702-d70a5d0ebf4f tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Calling method '.version_select at 0x7f2f2aa62c10>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:39.480746 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e440fdc5-1580-4c32-b702-d70a5d0ebf4f tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/715d3db0-c664-493c-8111-446b627c7cf3" status: 200 len: 286 microversion: 2.1 time: 0.132010 Nov 16 00:28:39.481363 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 3/16] 10.222.0.31 () {58 vars in 1250 bytes} [Tue Nov 16 00:28:39 2021] GET /compute/v2.1/os-snapshots/715d3db0-c664-493c-8111-446b627c7cf3 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:28:39.531103 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-7f4ea543-0b34-4e80-8683-1fce0fed39a7 tempest-VolumesGetTestJSON-1425853663 tempest-VolumesGetTestJSON-1425853663-project] Calling method '.version_select at 0x7f2f2b36be50>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:39.622310 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-7f4ea543-0b34-4e80-8683-1fce0fed39a7 tempest-VolumesGetTestJSON-1425853663 tempest-VolumesGetTestJSON-1425853663-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/20cf53f5-8e19-4822-920d-463b58573677" status: 200 len: 352 microversion: 2.1 time: 0.094766 Nov 16 00:28:39.622862 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 14/17] 10.222.0.31 () {58 vars in 1244 bytes} [Tue Nov 16 00:28:39 2021] GET /compute/v2.1/os-volumes/20cf53f5-8e19-4822-920d-463b58573677 => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:28:40.038524 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0081b5f5-4049-4a7a-9d1d-9b161d18c524 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:40.039174 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0081b5f5-4049-4a7a-9d1d-9b161d18c524 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:28:40.195467 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0081b5f5-4049-4a7a-9d1d-9b161d18c524 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:28:40.231411 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0081b5f5-4049-4a7a-9d1d-9b161d18c524 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1215 microversion: 2.1 time: 0.194697 Nov 16 00:28:40.232542 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 4/18] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:28:40 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1215 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:28:40.493036 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-0164ba32-c056-413c-bad2-826deeff2e60 tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Calling method '.version_select at 0x7f2f2b3303a0>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:40.526994 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-0164ba32-c056-413c-bad2-826deeff2e60 tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/715d3db0-c664-493c-8111-446b627c7cf3" status: 200 len: 286 microversion: 2.1 time: 0.037584 Nov 16 00:28:40.528251 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 15/19] 10.222.0.31 () {58 vars in 1250 bytes} [Tue Nov 16 00:28:40 2021] GET /compute/v2.1/os-snapshots/715d3db0-c664-493c-8111-446b627c7cf3 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:28:40.634505 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-ee75fc79-b56b-47c2-849d-6b75c27a0402 tempest-VolumesGetTestJSON-1425853663 tempest-VolumesGetTestJSON-1425853663-project] Calling method '.version_select at 0x7f2f2a209670>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:40.708137 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-ee75fc79-b56b-47c2-849d-6b75c27a0402 tempest-VolumesGetTestJSON-1425853663 tempest-VolumesGetTestJSON-1425853663-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/20cf53f5-8e19-4822-920d-463b58573677" status: 200 len: 352 microversion: 2.1 time: 0.077081 Nov 16 00:28:40.713021 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 5/20] 10.222.0.31 () {58 vars in 1244 bytes} [Tue Nov 16 00:28:40 2021] GET /compute/v2.1/os-volumes/20cf53f5-8e19-4822-920d-463b58573677 => generated 352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:28:41.268481 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c6d10e29-ea6a-43f4-8f08-6e5b536d1059 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:41.271334 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c6d10e29-ea6a-43f4-8f08-6e5b536d1059 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:28:41.284649 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c6d10e29-ea6a-43f4-8f08-6e5b536d1059 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:41.288155 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c6d10e29-ea6a-43f4-8f08-6e5b536d1059 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:41.290184 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c6d10e29-ea6a-43f4-8f08-6e5b536d1059 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:41.291716 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c6d10e29-ea6a-43f4-8f08-6e5b536d1059 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:41.476718 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c6d10e29-ea6a-43f4-8f08-6e5b536d1059 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:28:41.493460 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c6d10e29-ea6a-43f4-8f08-6e5b536d1059 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1211 microversion: 2.1 time: 0.236316 Nov 16 00:28:41.495483 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 16/21] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:28:41 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1211 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:28:41.541805 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-2f8d75d0-d329-4696-bbb7-d748a6d2e83d tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Calling method '.version_select at 0x7f2f2a21a8b0>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:41.592077 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-2f8d75d0-d329-4696-bbb7-d748a6d2e83d tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/715d3db0-c664-493c-8111-446b627c7cf3" status: 200 len: 287 microversion: 2.1 time: 0.057512 Nov 16 00:28:41.592976 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 6/22] 10.222.0.31 () {58 vars in 1250 bytes} [Tue Nov 16 00:28:41 2021] GET /compute/v2.1/os-snapshots/715d3db0-c664-493c-8111-446b627c7cf3 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:28:41.604237 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8f09ddd9-a64f-493f-a483-9f345ceab702 tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Calling method '.version_select at 0x7f2f2b2b65e0>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:41.710607 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8f09ddd9-a64f-493f-a483-9f345ceab702 tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] 10.222.0.31 "DELETE /compute/v2.1/os-snapshots/715d3db0-c664-493c-8111-446b627c7cf3" status: 202 len: 0 microversion: 2.1 time: 0.110237 Nov 16 00:28:41.715694 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 17/23] 10.222.0.31 () {58 vars in 1253 bytes} [Tue Nov 16 00:28:41 2021] DELETE /compute/v2.1/os-snapshots/715d3db0-c664-493c-8111-446b627c7cf3 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:28:41.722031 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a7c80b92-8973-4ece-8ba2-29dbdf8df34a tempest-VolumesGetTestJSON-1425853663 tempest-VolumesGetTestJSON-1425853663-project] Calling method '.version_select at 0x7f2f2a22a1f0>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:41.724618 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-10d1e958-0a32-449a-9525-d8529720cf81 tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Calling method '.version_select at 0x7f2f2b249c10>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:41.773878 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-a7c80b92-8973-4ece-8ba2-29dbdf8df34a tempest-VolumesGetTestJSON-1425853663 tempest-VolumesGetTestJSON-1425853663-project] HTTP exception thrown: Volume 20cf53f5-8e19-4822-920d-463b58573677 could not be found. Nov 16 00:28:41.774941 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a7c80b92-8973-4ece-8ba2-29dbdf8df34a tempest-VolumesGetTestJSON-1425853663 tempest-VolumesGetTestJSON-1425853663-project] Returning 404 to user: Volume 20cf53f5-8e19-4822-920d-463b58573677 could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:28:41.777851 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a7c80b92-8973-4ece-8ba2-29dbdf8df34a tempest-VolumesGetTestJSON-1425853663 tempest-VolumesGetTestJSON-1425853663-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/20cf53f5-8e19-4822-920d-463b58573677" status: 404 len: 109 microversion: 2.1 time: 0.060972 Nov 16 00:28:41.778595 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 7/24] 10.222.0.31 () {58 vars in 1244 bytes} [Tue Nov 16 00:28:41 2021] GET /compute/v2.1/os-volumes/20cf53f5-8e19-4822-920d-463b58573677 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:28:41.817739 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-10d1e958-0a32-449a-9525-d8529720cf81 tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/715d3db0-c664-493c-8111-446b627c7cf3" status: 200 len: 286 microversion: 2.1 time: 0.096874 Nov 16 00:28:41.818582 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 18/25] 10.222.0.31 () {58 vars in 1250 bytes} [Tue Nov 16 00:28:41 2021] GET /compute/v2.1/os-snapshots/715d3db0-c664-493c-8111-446b627c7cf3 => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:28:42.513101 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a874dd2e-152c-438e-9ab3-e3756de5f854 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:42.514644 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a874dd2e-152c-438e-9ab3-e3756de5f854 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:28:42.532072 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a874dd2e-152c-438e-9ab3-e3756de5f854 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:42.532703 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a874dd2e-152c-438e-9ab3-e3756de5f854 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:42.533949 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a874dd2e-152c-438e-9ab3-e3756de5f854 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:42.534592 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a874dd2e-152c-438e-9ab3-e3756de5f854 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:42.834572 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-01f8a97d-7966-4cac-842e-4166fa478bda tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Calling method '.version_select at 0x7f2f2b339160>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:42.904792 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-01f8a97d-7966-4cac-842e-4166fa478bda tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] HTTP exception thrown: Snapshot 715d3db0-c664-493c-8111-446b627c7cf3 could not be found. Nov 16 00:28:42.905558 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-01f8a97d-7966-4cac-842e-4166fa478bda tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Returning 404 to user: Snapshot 715d3db0-c664-493c-8111-446b627c7cf3 could not be found. {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:28:42.906493 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-01f8a97d-7966-4cac-842e-4166fa478bda tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/715d3db0-c664-493c-8111-446b627c7cf3" status: 404 len: 111 microversion: 2.1 time: 0.079769 Nov 16 00:28:42.907537 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 19/26] 10.222.0.31 () {58 vars in 1250 bytes} [Tue Nov 16 00:28:42 2021] GET /compute/v2.1/os-snapshots/715d3db0-c664-493c-8111-446b627c7cf3 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:28:42.915866 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-31c9543b-7366-43e3-b758-1dd89dec4bcb tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Calling method '.version_select at 0x7f2f2bd33ca0>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:43.076185 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-31c9543b-7366-43e3-b758-1dd89dec4bcb tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/9c059573-4b12-462f-848b-00ddd13ffd7a" status: 202 len: 0 microversion: 2.1 time: 0.163421 Nov 16 00:28:43.076772 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 20/27] 10.222.0.31 () {58 vars in 1247 bytes} [Tue Nov 16 00:28:42 2021] DELETE /compute/v2.1/os-volumes/9c059573-4b12-462f-848b-00ddd13ffd7a => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:28:43.086847 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-33bc4b2c-f6ef-485c-aad7-dc02b139ebf4 tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Calling method '.version_select at 0x7f2f2b2b6af0>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:43.214313 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-33bc4b2c-f6ef-485c-aad7-dc02b139ebf4 tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/9c059573-4b12-462f-848b-00ddd13ffd7a" status: 200 len: 345 microversion: 2.1 time: 0.131823 Nov 16 00:28:43.215329 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 21/28] 10.222.0.31 () {58 vars in 1244 bytes} [Tue Nov 16 00:28:43 2021] GET /compute/v2.1/os-volumes/9c059573-4b12-462f-848b-00ddd13ffd7a => generated 345 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:28:43.841135 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a874dd2e-152c-438e-9ab3-e3756de5f854 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:28:43.908095 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a874dd2e-152c-438e-9ab3-e3756de5f854 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1273 microversion: 2.1 time: 1.398926 Nov 16 00:28:43.910791 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 8/29] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:28:42 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1273 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:28:44.242638 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-3f507c6b-d453-467c-a818-7a6deec68fef tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Calling method '.version_select at 0x7f2f2b249af0>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:44.330649 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-3f507c6b-d453-467c-a818-7a6deec68fef tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] HTTP exception thrown: Volume 9c059573-4b12-462f-848b-00ddd13ffd7a could not be found. Nov 16 00:28:44.331360 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-3f507c6b-d453-467c-a818-7a6deec68fef tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Returning 404 to user: Volume 9c059573-4b12-462f-848b-00ddd13ffd7a could not be found. {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:28:44.332481 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-3f507c6b-d453-467c-a818-7a6deec68fef tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/9c059573-4b12-462f-848b-00ddd13ffd7a" status: 404 len: 109 microversion: 2.1 time: 0.106460 Nov 16 00:28:44.333565 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 22/30] 10.222.0.31 () {58 vars in 1244 bytes} [Tue Nov 16 00:28:44 2021] GET /compute/v2.1/os-volumes/9c059573-4b12-462f-848b-00ddd13ffd7a => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:28:44.357099 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-48b37917-c653-4d08-b7ee-3ea290f248b3 tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Calling method '.version_select at 0x7f2f2a1acc10>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:44.506139 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-48b37917-c653-4d08-b7ee-3ea290f248b3 tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] HTTP exception thrown: Volume 9c059573-4b12-462f-848b-00ddd13ffd7a could not be found. Nov 16 00:28:44.507398 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-48b37917-c653-4d08-b7ee-3ea290f248b3 tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Returning 404 to user: Volume 9c059573-4b12-462f-848b-00ddd13ffd7a could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:28:44.510253 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-48b37917-c653-4d08-b7ee-3ea290f248b3 tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/9c059573-4b12-462f-848b-00ddd13ffd7a" status: 404 len: 109 microversion: 2.1 time: 0.167642 Nov 16 00:28:44.511290 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 9/31] 10.222.0.31 () {58 vars in 1247 bytes} [Tue Nov 16 00:28:44 2021] DELETE /compute/v2.1/os-volumes/9c059573-4b12-462f-848b-00ddd13ffd7a => generated 109 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:28:44.524832 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ce9e8159-97f7-4554-b140-a96163f33fe9 tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Calling method '.version_select at 0x7f2f2b249af0>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:44.608202 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-ce9e8159-97f7-4554-b140-a96163f33fe9 tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] HTTP exception thrown: Volume 9c059573-4b12-462f-848b-00ddd13ffd7a could not be found. Nov 16 00:28:44.609229 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ce9e8159-97f7-4554-b140-a96163f33fe9 tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] Returning 404 to user: Volume 9c059573-4b12-462f-848b-00ddd13ffd7a could not be found. {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:28:44.610860 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ce9e8159-97f7-4554-b140-a96163f33fe9 tempest-VolumesSnapshotsTestJSON-489776737 tempest-VolumesSnapshotsTestJSON-489776737-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/9c059573-4b12-462f-848b-00ddd13ffd7a" status: 404 len: 109 microversion: 2.1 time: 0.091532 Nov 16 00:28:44.611889 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 23/32] 10.222.0.31 () {58 vars in 1244 bytes} [Tue Nov 16 00:28:44 2021] GET /compute/v2.1/os-volumes/9c059573-4b12-462f-848b-00ddd13ffd7a => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:28:44.933681 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-9282ba0d-d94a-48a0-871c-6b19d907bb5e tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:44.935618 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-9282ba0d-d94a-48a0-871c-6b19d907bb5e tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:28:44.965358 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9282ba0d-d94a-48a0-871c-6b19d907bb5e tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:44.966133 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9282ba0d-d94a-48a0-871c-6b19d907bb5e tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:44.967554 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9282ba0d-d94a-48a0-871c-6b19d907bb5e tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:44.968319 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9282ba0d-d94a-48a0-871c-6b19d907bb5e tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:45.975290 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-9282ba0d-d94a-48a0-871c-6b19d907bb5e tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:28:46.006770 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-9282ba0d-d94a-48a0-871c-6b19d907bb5e tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1315 microversion: 2.1 time: 1.078926 Nov 16 00:28:46.009275 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 10/33] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:28:44 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1315 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:28:47.027118 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-264cc8b7-ba96-4209-ba63-8a9f310ea688 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:47.028105 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-264cc8b7-ba96-4209-ba63-8a9f310ea688 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:28:47.041864 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-264cc8b7-ba96-4209-ba63-8a9f310ea688 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:47.042620 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-264cc8b7-ba96-4209-ba63-8a9f310ea688 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:47.045434 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-264cc8b7-ba96-4209-ba63-8a9f310ea688 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:47.047871 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-264cc8b7-ba96-4209-ba63-8a9f310ea688 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:48.497722 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-264cc8b7-ba96-4209-ba63-8a9f310ea688 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:28:48.509205 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-264cc8b7-ba96-4209-ba63-8a9f310ea688 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1315 microversion: 2.1 time: 1.486189 Nov 16 00:28:48.512647 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 24/34] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:28:47 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1315 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:28:49.528051 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-6c990baa-2196-4217-b7a2-0eea013937b5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:49.528652 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-6c990baa-2196-4217-b7a2-0eea013937b5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:28:49.540280 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6c990baa-2196-4217-b7a2-0eea013937b5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:49.542229 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6c990baa-2196-4217-b7a2-0eea013937b5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:49.544753 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6c990baa-2196-4217-b7a2-0eea013937b5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:49.546184 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6c990baa-2196-4217-b7a2-0eea013937b5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:50.370600 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-6c990baa-2196-4217-b7a2-0eea013937b5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:28:50.414115 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-6c990baa-2196-4217-b7a2-0eea013937b5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1315 microversion: 2.1 time: 0.887268 Nov 16 00:28:50.417210 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 11/35] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:28:49 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1315 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:28:50.704743 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-db2d8714-ad0f-41c7-94f1-f86239178085 req-e7cb5d6e-e900-4f74-a135-60046c66eccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bea7d54f-7240-4037-b2c3-137104f78dac", "tag": "039fa937-ef8e-4555-be41-74f1bdbe2313"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:28:50.724300 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:28:50.724300 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:28:50.791428 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-db2d8714-ad0f-41c7-94f1-f86239178085 req-e7cb5d6e-e900-4f74-a135-60046c66eccc service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:50.796512 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-db2d8714-ad0f-41c7-94f1-f86239178085 req-e7cb5d6e-e900-4f74-a135-60046c66eccc service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:50.935105 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-db2d8714-ad0f-41c7-94f1-f86239178085 req-e7cb5d6e-e900-4f74-a135-60046c66eccc service nova] Creating event network-changed:039fa937-ef8e-4555-be41-74f1bdbe2313 for instance bea7d54f-7240-4037-b2c3-137104f78dac on hv-cinder-81115 Nov 16 00:28:50.944062 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-db2d8714-ad0f-41c7-94f1-f86239178085 req-e7cb5d6e-e900-4f74-a135-60046c66eccc service nova] Acquired lock "compute-rpcapi-router" {{(pid=122543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Nov 16 00:28:50.956144 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-488db70e-b1dd-4149-b3c4-ddb9f6b88198 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:50.959107 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-488db70e-b1dd-4149-b3c4-ddb9f6b88198 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:50.965624 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-488db70e-b1dd-4149-b3c4-ddb9f6b88198 None None] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:50.971623 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-488db70e-b1dd-4149-b3c4-ddb9f6b88198 None None] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:51.017138 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.compute.rpcapi [None req-488db70e-b1dd-4149-b3c4-ddb9f6b88198 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 16 00:28:51.022870 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-488db70e-b1dd-4149-b3c4-ddb9f6b88198 None None] Releasing lock "compute-rpcapi-router" {{(pid=122543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Nov 16 00:28:51.179706 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-488db70e-b1dd-4149-b3c4-ddb9f6b88198 None None] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.806761 Nov 16 00:28:51.181747 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 25/36] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:28:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:28:51.442510 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-8c42e172-a35f-4c8d-bcb6-9eeec81a7a6e tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:51.443897 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-8c42e172-a35f-4c8d-bcb6-9eeec81a7a6e tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:28:51.468056 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8c42e172-a35f-4c8d-bcb6-9eeec81a7a6e tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:51.469524 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8c42e172-a35f-4c8d-bcb6-9eeec81a7a6e tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:51.482218 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8c42e172-a35f-4c8d-bcb6-9eeec81a7a6e tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:51.483164 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8c42e172-a35f-4c8d-bcb6-9eeec81a7a6e tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:52.522720 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-8c42e172-a35f-4c8d-bcb6-9eeec81a7a6e tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:28:52.610852 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-8c42e172-a35f-4c8d-bcb6-9eeec81a7a6e tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1315 microversion: 2.1 time: 1.173101 Nov 16 00:28:52.633501 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 12/37] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:28:51 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1315 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:28:53.647296 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-6fb9cc16-2283-437f-b5ff-5df35bd8f1b6 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:53.656785 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-6fb9cc16-2283-437f-b5ff-5df35bd8f1b6 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:28:53.712384 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6fb9cc16-2283-437f-b5ff-5df35bd8f1b6 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:53.716356 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6fb9cc16-2283-437f-b5ff-5df35bd8f1b6 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:53.720410 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6fb9cc16-2283-437f-b5ff-5df35bd8f1b6 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:53.722863 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6fb9cc16-2283-437f-b5ff-5df35bd8f1b6 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:54.388812 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-5db94655-6189-4288-a176-264a13067118 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'create', calling method: .version_select at 0x7f2f2b207f70>, body: {"keypair": {"name": "tempest-keypair-2141648772"}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:28:54.846316 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-5db94655-6189-4288-a176-264a13067118 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Getting quotas for project 6a41a4472a974da5aee5d6b458d9f619. Resources: {'key_pairs'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:28:54.916994 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-5db94655-6189-4288-a176-264a13067118 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Getting quotas for user a9913646689d4e678fbb35098466ec8a and project 6a41a4472a974da5aee5d6b458d9f619. Resources: {'key_pairs'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:28:54.956732 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-6fb9cc16-2283-437f-b5ff-5df35bd8f1b6 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:28:54.975078 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-6fb9cc16-2283-437f-b5ff-5df35bd8f1b6 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1315 microversion: 2.1 time: 1.337183 Nov 16 00:28:54.981420 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 13/38] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:28:53 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1315 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:28:55.878121 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-5db94655-6189-4288-a176-264a13067118 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Getting quotas for project 6a41a4472a974da5aee5d6b458d9f619. Resources: {'key_pairs'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:28:55.892590 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-5db94655-6189-4288-a176-264a13067118 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Getting quotas for user a9913646689d4e678fbb35098466ec8a and project 6a41a4472a974da5aee5d6b458d9f619. Resources: {'key_pairs'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:28:55.955366 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-5db94655-6189-4288-a176-264a13067118 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 3.593270 Nov 16 00:28:55.956061 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 26/39] 10.222.0.31 () {62 vars in 1198 bytes} [Tue Nov 16 00:28:52 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 3595 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 16 00:28:56.005634 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f0aac18c-93fb-445c-86f9-3f3a78430d43 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:56.006423 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f0aac18c-93fb-445c-86f9-3f3a78430d43 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:28:56.019710 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f0aac18c-93fb-445c-86f9-3f3a78430d43 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:56.020264 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f0aac18c-93fb-445c-86f9-3f3a78430d43 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:56.021149 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f0aac18c-93fb-445c-86f9-3f3a78430d43 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:56.021559 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f0aac18c-93fb-445c-86f9-3f3a78430d43 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:56.120197 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3311cb8f-5019-40d7-9fda-44b9da9d2966 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-715218215", "imageRef": "bb47ca05-3b48-4f1c-bc96-e0c5c672caba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2716731e-1433-4cb7-8b9e-2e41adaa7566"}]}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:28:56.425289 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.network.neutron [None req-3311cb8f-5019-40d7-9fda-44b9da9d2966 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] validate_networks() for [('2716731e-1433-4cb7-8b9e-2e41adaa7566', None, None, None, None, None)] {{(pid=122544) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:28:57.491768 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f0aac18c-93fb-445c-86f9-3f3a78430d43 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:28:57.511899 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f0aac18c-93fb-445c-86f9-3f3a78430d43 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1315 microversion: 2.1 time: 1.509963 Nov 16 00:28:57.514606 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 27/40] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:28:55 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1315 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:28:58.535502 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c440bd20-cc78-47c0-baa0-7ef6593f24df tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:58.536913 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c440bd20-cc78-47c0-baa0-7ef6593f24df tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:28:58.583909 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c440bd20-cc78-47c0-baa0-7ef6593f24df tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:58.584768 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c440bd20-cc78-47c0-baa0-7ef6593f24df tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:58.586276 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c440bd20-cc78-47c0-baa0-7ef6593f24df tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:58.610716 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c440bd20-cc78-47c0-baa0-7ef6593f24df tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:59.644647 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-3311cb8f-5019-40d7-9fda-44b9da9d2966 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Flavor limits 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:28:59.655865 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-3311cb8f-5019-40d7-9fda-44b9da9d2966 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Image limits 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:28:59.661527 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-3311cb8f-5019-40d7-9fda-44b9da9d2966 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Flavor pref 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:28:59.662585 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-3311cb8f-5019-40d7-9fda-44b9da9d2966 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Image pref 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:28:59.665890 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-3311cb8f-5019-40d7-9fda-44b9da9d2966 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:28:59.693478 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3311cb8f-5019-40d7-9fda-44b9da9d2966 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:59.694657 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3311cb8f-5019-40d7-9fda-44b9da9d2966 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:59.696575 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3311cb8f-5019-40d7-9fda-44b9da9d2966 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:28:59.698284 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3311cb8f-5019-40d7-9fda-44b9da9d2966 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:28:59.743506 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-3311cb8f-5019-40d7-9fda-44b9da9d2966 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Getting quotas for project 1e424e3f6e1d448fb921f87b10aa1fc5. Resources: {'instances', 'cores', 'ram'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:28:59.752347 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-3311cb8f-5019-40d7-9fda-44b9da9d2966 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Getting quotas for user c0dcf62ea9db4f25a774090e59d726b6 and project 1e424e3f6e1d448fb921f87b10aa1fc5. Resources: {'instances', 'cores', 'ram'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:28:59.799077 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3311cb8f-5019-40d7-9fda-44b9da9d2966 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Going to run 1 instances... {{(pid=122544) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:28:59.805523 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3311cb8f-5019-40d7-9fda-44b9da9d2966 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb47ca05-3b48-4f1c-bc96-e0c5c672caba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:28:59.944262 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-3311cb8f-5019-40d7-9fda-44b9da9d2966 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.960495 Nov 16 00:28:59.948443 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 14/41] 10.222.0.31 () {60 vars in 1146 bytes} [Tue Nov 16 00:28:54 2021] POST /compute/v2.1/servers => generated 383 bytes in 4966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 00:28:59.961884 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c440bd20-cc78-47c0-baa0-7ef6593f24df tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:28:59.978940 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c440bd20-cc78-47c0-baa0-7ef6593f24df tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1315 microversion: 2.1 time: 1.451005 Nov 16 00:28:59.991504 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 28/42] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:28:58 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1315 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:28:59.996303 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ab0177b1-79b1-4be4-a867-bd223481bfa1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:28:59.996925 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ab0177b1-79b1-4be4-a867-bd223481bfa1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:00.118386 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-ab0177b1-79b1-4be4-a867-bd223481bfa1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:00.126286 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ab0177b1-79b1-4be4-a867-bd223481bfa1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1221 microversion: 2.1 time: 0.133540 Nov 16 00:29:00.145967 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 29/43] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:28:59 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1221 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:00.913471 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-8dc655db-4cfe-47f6-a3e4-10b71ea97204 tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] Action: 'create', calling method: .version_select at 0x7f2f2a14ee50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2120690359", "metadata": {"Type": "work"}}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:00.926044 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-8dc655db-4cfe-47f6-a3e4-10b71ea97204 tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:29:00.932253 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-8dc655db-4cfe-47f6-a3e4-10b71ea97204 tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.981494 Nov 16 00:29:00.934959 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 15/44] 10.222.0.31 () {60 vars in 1155 bytes} [Tue Nov 16 00:28:59 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 986 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 16 00:29:00.945028 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-149b315d-b350-4dff-abc0-a6505f727995 tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] Action: 'create', calling method: .version_select at 0x7f2f2b2a5af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-248179719", "metadata": {"Type": "work"}}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:00.946928 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-149b315d-b350-4dff-abc0-a6505f727995 tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:29:00.948340 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-149b315d-b350-4dff-abc0-a6505f727995 tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007463 Nov 16 00:29:00.949241 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 30/45] 10.222.0.31 () {60 vars in 1155 bytes} [Tue Nov 16 00:29:00 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 16 00:29:00.977089 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-3b38c71e-0bfa-42e1-bb77-96268b82b6a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1358819793", "imageRef": "bb47ca05-3b48-4f1c-bc96-e0c5c672caba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2716731e-1433-4cb7-8b9e-2e41adaa7566"}]}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:00.981983 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-fc80818b-cbe9-4077-b54d-f382eb8d51d2 tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] Action: 'create', calling method: .version_select at 0x7f2f2a209820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-325276828", "metadata": {"Type": "work"}}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:00.984321 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-fc80818b-cbe9-4077-b54d-f382eb8d51d2 tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:29:00.985906 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-fc80818b-cbe9-4077-b54d-f382eb8d51d2 tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.025862 Nov 16 00:29:00.986944 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 16/46] 10.222.0.31 () {60 vars in 1155 bytes} [Tue Nov 16 00:29:00 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 16 00:29:01.037223 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-6200c76e-037c-498d-a4a1-8ae400fbaa53 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:01.037995 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-6200c76e-037c-498d-a4a1-8ae400fbaa53 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:01.068510 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6200c76e-037c-498d-a4a1-8ae400fbaa53 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:01.069150 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6200c76e-037c-498d-a4a1-8ae400fbaa53 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:01.070108 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6200c76e-037c-498d-a4a1-8ae400fbaa53 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:01.070706 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6200c76e-037c-498d-a4a1-8ae400fbaa53 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:01.273187 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.network.neutron [None req-3b38c71e-0bfa-42e1-bb77-96268b82b6a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] validate_networks() for [('2716731e-1433-4cb7-8b9e-2e41adaa7566', None, None, None, None, None)] {{(pid=122543) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:29:01.701161 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-6200c76e-037c-498d-a4a1-8ae400fbaa53 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:01.742747 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-6200c76e-037c-498d-a4a1-8ae400fbaa53 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1315 microversion: 2.1 time: 0.730658 Nov 16 00:29:01.777806 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 17/47] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:01 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1315 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:01.792730 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-99c0e1bf-ecc0-4f99-9371-f86903c4bafb tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] Calling method '.version_select at 0x7f2f2a178310>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:01.873281 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-99c0e1bf-ecc0-4f99-9371-f86903c4bafb tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] HTTP exception thrown: Volume tempest-invalid-602493968 could not be found. Nov 16 00:29:01.874033 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-99c0e1bf-ecc0-4f99-9371-f86903c4bafb tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] Returning 404 to user: Volume tempest-invalid-602493968 could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:29:01.875613 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-99c0e1bf-ecc0-4f99-9371-f86903c4bafb tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/tempest-invalid-602493968" status: 404 len: 98 microversion: 2.1 time: 0.095070 Nov 16 00:29:01.876626 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 18/48] 10.222.0.31 () {58 vars in 1214 bytes} [Tue Nov 16 00:29:01 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-602493968 => generated 98 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 16 00:29:01.889435 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-511e4968-e50e-4ab0-8856-399268171d39 tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005927 Nov 16 00:29:01.890702 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 19/49] 10.222.0.31 () {58 vars in 1139 bytes} [Tue Nov 16 00:29:01 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 16 00:29:01.913078 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-9ad4e457-29ba-4517-a526-77cdfe9ae033 tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007951 Nov 16 00:29:01.918421 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 20/50] 10.222.0.31 () {58 vars in 1136 bytes} [Tue Nov 16 00:29:01 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 16 00:29:01.946118 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-253f49c8-c27f-4734-a9dc-46e1a57ca92b tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] Calling method '.version_select at 0x7f2f2a16b4c0>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:02.046366 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-253f49c8-c27f-4734-a9dc-46e1a57ca92b tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] HTTP exception thrown: Volume 4249d964-9993-4608-a2fd-15769efbb9d0 could not be found. Nov 16 00:29:02.047251 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-253f49c8-c27f-4734-a9dc-46e1a57ca92b tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] Returning 404 to user: Volume 4249d964-9993-4608-a2fd-15769efbb9d0 could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:29:02.048911 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-253f49c8-c27f-4734-a9dc-46e1a57ca92b tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/4249d964-9993-4608-a2fd-15769efbb9d0" status: 404 len: 109 microversion: 2.1 time: 0.123873 Nov 16 00:29:02.050402 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 21/51] 10.222.0.31 () {58 vars in 1247 bytes} [Tue Nov 16 00:29:01 2021] DELETE /compute/v2.1/os-volumes/4249d964-9993-4608-a2fd-15769efbb9d0 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 00:29:02.081985 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-285ea36a-1967-43cb-a710-ceccb9d8d4b7 tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] Calling method '.version_select at 0x7f2f2a1781f0>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:02.172399 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-285ea36a-1967-43cb-a710-ceccb9d8d4b7 tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] HTTP exception thrown: Volume c8875e6e-9eef-4e08-9ca3-c86e19c8ce96 could not be found. Nov 16 00:29:02.172980 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-285ea36a-1967-43cb-a710-ceccb9d8d4b7 tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] Returning 404 to user: Volume c8875e6e-9eef-4e08-9ca3-c86e19c8ce96 could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:29:02.173865 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-285ea36a-1967-43cb-a710-ceccb9d8d4b7 tempest-VolumesNegativeTest-898093583 tempest-VolumesNegativeTest-898093583-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/c8875e6e-9eef-4e08-9ca3-c86e19c8ce96" status: 404 len: 109 microversion: 2.1 time: 0.117057 Nov 16 00:29:02.174386 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 22/52] 10.222.0.31 () {58 vars in 1244 bytes} [Tue Nov 16 00:29:02 2021] GET /compute/v2.1/os-volumes/c8875e6e-9eef-4e08-9ca3-c86e19c8ce96 => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:29:03.337033 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-68081e17-9154-446b-98db-75701d22ae24 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'create', calling method: .version_select at 0x7f2f2a18faf0>, body: {"keypair": {"name": "tempest-keypair-128653493"}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:03.465228 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-68081e17-9154-446b-98db-75701d22ae24 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Getting quotas for project a0f2408fc1d043e581cf3406f493b307. Resources: {'key_pairs'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:29:03.482801 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-68081e17-9154-446b-98db-75701d22ae24 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Getting quotas for user 722e3d22cb754e55aec75f2b8b24ca19 and project a0f2408fc1d043e581cf3406f493b307. Resources: {'key_pairs'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:29:03.895188 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-68081e17-9154-446b-98db-75701d22ae24 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Getting quotas for project a0f2408fc1d043e581cf3406f493b307. Resources: {'key_pairs'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:29:03.914793 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-68081e17-9154-446b-98db-75701d22ae24 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Getting quotas for user 722e3d22cb754e55aec75f2b8b24ca19 and project a0f2408fc1d043e581cf3406f493b307. Resources: {'key_pairs'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:29:03.970275 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-68081e17-9154-446b-98db-75701d22ae24 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.581248 Nov 16 00:29:03.971504 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 23/53] 10.222.0.31 () {60 vars in 1157 bytes} [Tue Nov 16 00:29:02 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:03.985313 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-2f6e189e-8b89-4d27-bdb6-a96442144d07 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:03.995683 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-2f6e189e-8b89-4d27-bdb6-a96442144d07 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:04.015762 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2f6e189e-8b89-4d27-bdb6-a96442144d07 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:04.016641 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2f6e189e-8b89-4d27-bdb6-a96442144d07 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:04.018033 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2f6e189e-8b89-4d27-bdb6-a96442144d07 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:04.018776 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2f6e189e-8b89-4d27-bdb6-a96442144d07 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:05.001360 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-2f6e189e-8b89-4d27-bdb6-a96442144d07 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:05.015376 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-2f6e189e-8b89-4d27-bdb6-a96442144d07 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1315 microversion: 2.1 time: 1.036836 Nov 16 00:29:05.031368 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 24/54] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:03 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1315 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:05.275662 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-3b38c71e-0bfa-42e1-bb77-96268b82b6a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Flavor limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:29:05.279091 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-3b38c71e-0bfa-42e1-bb77-96268b82b6a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Image limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:29:05.279572 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-3b38c71e-0bfa-42e1-bb77-96268b82b6a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Flavor pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:29:05.280000 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-3b38c71e-0bfa-42e1-bb77-96268b82b6a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Image pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:29:05.285486 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-3b38c71e-0bfa-42e1-bb77-96268b82b6a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:29:05.311929 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3b38c71e-0bfa-42e1-bb77-96268b82b6a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:05.312481 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3b38c71e-0bfa-42e1-bb77-96268b82b6a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:05.314893 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3b38c71e-0bfa-42e1-bb77-96268b82b6a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:05.317901 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3b38c71e-0bfa-42e1-bb77-96268b82b6a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:05.392388 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-3b38c71e-0bfa-42e1-bb77-96268b82b6a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Getting quotas for project 1e424e3f6e1d448fb921f87b10aa1fc5. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:29:05.406018 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-3b38c71e-0bfa-42e1-bb77-96268b82b6a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Getting quotas for user c0dcf62ea9db4f25a774090e59d726b6 and project 1e424e3f6e1d448fb921f87b10aa1fc5. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:29:05.437965 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-3b38c71e-0bfa-42e1-bb77-96268b82b6a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Going to run 1 instances... {{(pid=122543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:29:05.447122 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-3b38c71e-0bfa-42e1-bb77-96268b82b6a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb47ca05-3b48-4f1c-bc96-e0c5c672caba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:29:05.648349 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-3b38c71e-0bfa-42e1-bb77-96268b82b6a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.677142 Nov 16 00:29:05.650973 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 31/55] 10.222.0.31 () {60 vars in 1146 bytes} [Tue Nov 16 00:29:00 2021] POST /compute/v2.1/servers => generated 383 bytes in 4681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 00:29:05.665964 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d3633720-c0bf-429d-9bee-65b04f07ccb1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:05.667107 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d3633720-c0bf-429d-9bee-65b04f07ccb1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:06.047606 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-99486939-3d3a-48dd-bf55-1ba62a1d4b2a tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:06.051559 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-99486939-3d3a-48dd-bf55-1ba62a1d4b2a tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:06.075316 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d3633720-c0bf-429d-9bee-65b04f07ccb1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:06.084192 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-99486939-3d3a-48dd-bf55-1ba62a1d4b2a tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:06.085730 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-99486939-3d3a-48dd-bf55-1ba62a1d4b2a tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:06.087370 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-99486939-3d3a-48dd-bf55-1ba62a1d4b2a tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:06.088847 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-99486939-3d3a-48dd-bf55-1ba62a1d4b2a tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:06.096380 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d3633720-c0bf-429d-9bee-65b04f07ccb1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1222 microversion: 2.1 time: 0.438385 Nov 16 00:29:06.104623 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 25/56] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:05 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1222 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:06.278948 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-7c8eda3b-dcbb-409e-9623-13624b16d3f0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-218477499", "imageRef": "bb47ca05-3b48-4f1c-bc96-e0c5c672caba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8b59832-05f6-4e7c-ada4-45e801ce41ec"}], "security_groups": [{"name": "tempest-securitygroup--53665819"}], "key_name": "tempest-keypair-2141648772", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:06.619517 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.network.neutron [None req-7c8eda3b-dcbb-409e-9623-13624b16d3f0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] validate_networks() for [('f8b59832-05f6-4e7c-ada4-45e801ce41ec', None, None, None, None, None)] {{(pid=122544) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:29:06.815770 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-99486939-3d3a-48dd-bf55-1ba62a1d4b2a tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:06.835186 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-99486939-3d3a-48dd-bf55-1ba62a1d4b2a tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1315 microversion: 2.1 time: 0.802477 Nov 16 00:29:06.842000 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 32/57] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:06 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:07.130025 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-5aa64807-506b-4d2d-8a95-d6cceb36a64a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:07.134852 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-5aa64807-506b-4d2d-8a95-d6cceb36a64a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:07.162217 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5aa64807-506b-4d2d-8a95-d6cceb36a64a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:07.169510 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5aa64807-506b-4d2d-8a95-d6cceb36a64a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:07.170888 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5aa64807-506b-4d2d-8a95-d6cceb36a64a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:07.173704 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5aa64807-506b-4d2d-8a95-d6cceb36a64a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:07.491634 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-5aa64807-506b-4d2d-8a95-d6cceb36a64a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:07.528405 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-5aa64807-506b-4d2d-8a95-d6cceb36a64a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1274 microversion: 2.1 time: 0.407923 Nov 16 00:29:07.534383 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 33/58] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:07 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1274 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:07.890783 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-63d23d37-cad8-4470-b6e1-d6212857bd99 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:07.891709 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-63d23d37-cad8-4470-b6e1-d6212857bd99 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:07.909292 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-63d23d37-cad8-4470-b6e1-d6212857bd99 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:07.920018 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-63d23d37-cad8-4470-b6e1-d6212857bd99 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:07.934018 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-63d23d37-cad8-4470-b6e1-d6212857bd99 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:07.937421 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-63d23d37-cad8-4470-b6e1-d6212857bd99 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:08.713472 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-7c8eda3b-dcbb-409e-9623-13624b16d3f0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Flavor limits 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:29:08.715711 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-7c8eda3b-dcbb-409e-9623-13624b16d3f0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Image limits 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:29:08.717269 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-7c8eda3b-dcbb-409e-9623-13624b16d3f0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Flavor pref 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:29:08.718315 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-7c8eda3b-dcbb-409e-9623-13624b16d3f0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Image pref 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:29:08.720463 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-7c8eda3b-dcbb-409e-9623-13624b16d3f0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:29:08.742785 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7c8eda3b-dcbb-409e-9623-13624b16d3f0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:08.744188 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7c8eda3b-dcbb-409e-9623-13624b16d3f0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:08.746419 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7c8eda3b-dcbb-409e-9623-13624b16d3f0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:08.748036 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7c8eda3b-dcbb-409e-9623-13624b16d3f0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:08.814648 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-7c8eda3b-dcbb-409e-9623-13624b16d3f0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Getting quotas for project 6a41a4472a974da5aee5d6b458d9f619. Resources: {'instances', 'cores', 'ram'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:29:08.825783 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-7c8eda3b-dcbb-409e-9623-13624b16d3f0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Getting quotas for user a9913646689d4e678fbb35098466ec8a and project 6a41a4472a974da5aee5d6b458d9f619. Resources: {'instances', 'cores', 'ram'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:29:08.857999 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-7c8eda3b-dcbb-409e-9623-13624b16d3f0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Going to run 1 instances... {{(pid=122544) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:29:08.863640 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-7c8eda3b-dcbb-409e-9623-13624b16d3f0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb47ca05-3b48-4f1c-bc96-e0c5c672caba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:29:08.916415 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-63d23d37-cad8-4470-b6e1-d6212857bd99 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:08.970914 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-63d23d37-cad8-4470-b6e1-d6212857bd99 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1315 microversion: 2.1 time: 1.099785 Nov 16 00:29:08.976372 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 34/59] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:07 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1315 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:08.999170 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-3a7df373-28bf-400f-825d-b072c0bdcb4e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:09.000568 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-3a7df373-28bf-400f-825d-b072c0bdcb4e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:09.011403 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-7c8eda3b-dcbb-409e-9623-13624b16d3f0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 2.751063 Nov 16 00:29:09.022027 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 26/60] 10.222.0.31 () {62 vars in 1187 bytes} [Tue Nov 16 00:29:06 2021] POST /compute/v2.1/servers => generated 400 bytes in 2762 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 16 00:29:09.025666 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3a7df373-28bf-400f-825d-b072c0bdcb4e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:09.026325 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3a7df373-28bf-400f-825d-b072c0bdcb4e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:09.027892 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3a7df373-28bf-400f-825d-b072c0bdcb4e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:09.033151 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3a7df373-28bf-400f-825d-b072c0bdcb4e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:09.051421 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-624ae1aa-50cb-466e-a243-06470439eec3 req-2d7294c3-682b-43e7-867f-4df3447b5269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "896600e3-829b-43f9-87af-60d271f05432", "tag": "c1f88a1d-9b68-4cbe-84d4-91309b1307d6"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:09.056565 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:29:09.056565 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:29:09.179751 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-624ae1aa-50cb-466e-a243-06470439eec3 req-2d7294c3-682b-43e7-867f-4df3447b5269 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:09.182073 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-624ae1aa-50cb-466e-a243-06470439eec3 req-2d7294c3-682b-43e7-867f-4df3447b5269 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:09.340159 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-624ae1aa-50cb-466e-a243-06470439eec3 req-2d7294c3-682b-43e7-867f-4df3447b5269 service nova] Creating event network-changed:c1f88a1d-9b68-4cbe-84d4-91309b1307d6 for instance 896600e3-829b-43f9-87af-60d271f05432 on hv-cinder-81115 Nov 16 00:29:09.342326 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-624ae1aa-50cb-466e-a243-06470439eec3 req-2d7294c3-682b-43e7-867f-4df3447b5269 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122544) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Nov 16 00:29:09.351953 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-73e480b1-7339-4c2f-bfdc-d311493f9c26 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:09.353900 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-73e480b1-7339-4c2f-bfdc-d311493f9c26 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:09.356103 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-73e480b1-7339-4c2f-bfdc-d311493f9c26 None None] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:09.359408 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-73e480b1-7339-4c2f-bfdc-d311493f9c26 None None] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:09.383969 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.compute.rpcapi [None req-73e480b1-7339-4c2f-bfdc-d311493f9c26 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 16 00:29:09.386444 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-73e480b1-7339-4c2f-bfdc-d311493f9c26 None None] Releasing lock "compute-rpcapi-router" {{(pid=122544) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Nov 16 00:29:09.448936 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-73e480b1-7339-4c2f-bfdc-d311493f9c26 None None] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.424092 Nov 16 00:29:09.455167 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 27/61] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:29:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:29:09.466747 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-62ff0aee-a97c-4d5d-a074-665ecdaef327 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:09.468975 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-62ff0aee-a97c-4d5d-a074-665ecdaef327 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:09.751821 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-3a7df373-28bf-400f-825d-b072c0bdcb4e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:09.770110 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-3a7df373-28bf-400f-825d-b072c0bdcb4e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1280 microversion: 2.1 time: 0.792445 Nov 16 00:29:09.771341 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 35/62] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:08 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1280 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:09.801203 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-62ff0aee-a97c-4d5d-a074-665ecdaef327 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:09.830879 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-62ff0aee-a97c-4d5d-a074-665ecdaef327 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:09.836334 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-62ff0aee-a97c-4d5d-a074-665ecdaef327 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:09.844585 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-62ff0aee-a97c-4d5d-a074-665ecdaef327 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1281 microversion: 2.20 time: 0.381307 Nov 16 00:29:09.866105 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 28/63] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:29:09 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1281 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:29:10.013933 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f536f980-438f-471f-9908-c1eef96c6895 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:10.021134 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f536f980-438f-471f-9908-c1eef96c6895 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:10.048023 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f536f980-438f-471f-9908-c1eef96c6895 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:10.052841 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f536f980-438f-471f-9908-c1eef96c6895 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:10.055124 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f536f980-438f-471f-9908-c1eef96c6895 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:10.056376 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f536f980-438f-471f-9908-c1eef96c6895 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:10.732579 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-f536f980-438f-471f-9908-c1eef96c6895 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:10.746354 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-f536f980-438f-471f-9908-c1eef96c6895 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1315 microversion: 2.1 time: 0.744406 Nov 16 00:29:10.752543 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-d2f48e77-dc12-4e0e-a17a-77d40bc9eccc req-d535474f-c46c-4f8f-bd81-f277491ee1ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea7d54f-7240-4037-b2c3-137104f78dac", "name": "network-vif-plugged", "status": "completed", "tag": "039fa937-ef8e-4555-be41-74f1bdbe2313"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:10.755871 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:29:10.755871 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:29:10.764978 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 29/64] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:10 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1315 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:10.784877 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-d2f48e77-dc12-4e0e-a17a-77d40bc9eccc req-d535474f-c46c-4f8f-bd81-f277491ee1ce service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:10.785903 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-d2f48e77-dc12-4e0e-a17a-77d40bc9eccc req-d535474f-c46c-4f8f-bd81-f277491ee1ce service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:10.797246 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3beeca40-bb40-4572-af26-e10451b6da89 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:10.798262 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3beeca40-bb40-4572-af26-e10451b6da89 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:10.816530 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3beeca40-bb40-4572-af26-e10451b6da89 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:10.817611 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3beeca40-bb40-4572-af26-e10451b6da89 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:10.822220 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3beeca40-bb40-4572-af26-e10451b6da89 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:10.825738 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3beeca40-bb40-4572-af26-e10451b6da89 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:10.830971 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-d2f48e77-dc12-4e0e-a17a-77d40bc9eccc req-d535474f-c46c-4f8f-bd81-f277491ee1ce service nova] Creating event network-vif-plugged:039fa937-ef8e-4555-be41-74f1bdbe2313 for instance bea7d54f-7240-4037-b2c3-137104f78dac on hv-cinder-81115 Nov 16 00:29:10.858905 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-d2f48e77-dc12-4e0e-a17a-77d40bc9eccc req-d535474f-c46c-4f8f-bd81-f277491ee1ce service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.085960 Nov 16 00:29:10.862538 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 36/65] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:29:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:29:10.887261 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-4fda2e1c-acde-4412-8b22-4c7d4409bdbc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:10.888864 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-4fda2e1c-acde-4412-8b22-4c7d4409bdbc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:10.926982 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4fda2e1c-acde-4412-8b22-4c7d4409bdbc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:10.927641 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4fda2e1c-acde-4412-8b22-4c7d4409bdbc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:10.928642 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4fda2e1c-acde-4412-8b22-4c7d4409bdbc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:10.929527 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4fda2e1c-acde-4412-8b22-4c7d4409bdbc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:11.077195 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3beeca40-bb40-4572-af26-e10451b6da89 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:11.092623 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-3beeca40-bb40-4572-af26-e10451b6da89 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1280 microversion: 2.1 time: 0.297616 Nov 16 00:29:11.096832 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 30/66] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:10 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1280 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:11.216809 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-4fda2e1c-acde-4412-8b22-4c7d4409bdbc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:11.226989 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-4fda2e1c-acde-4412-8b22-4c7d4409bdbc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:11.240692 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-4fda2e1c-acde-4412-8b22-4c7d4409bdbc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:11.242344 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-4fda2e1c-acde-4412-8b22-4c7d4409bdbc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1333 microversion: 2.20 time: 0.367982 Nov 16 00:29:11.243665 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 37/67] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:29:10 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1333 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:29:11.807916 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-37025205-5e88-4a19-b60c-1367d9d01d23 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:11.813881 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-37025205-5e88-4a19-b60c-1367d9d01d23 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:11.849790 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-37025205-5e88-4a19-b60c-1367d9d01d23 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:11.850406 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-37025205-5e88-4a19-b60c-1367d9d01d23 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:11.852716 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-37025205-5e88-4a19-b60c-1367d9d01d23 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:11.853253 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-37025205-5e88-4a19-b60c-1367d9d01d23 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:12.121080 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-909bea17-6702-48b8-9104-2cb7d61d492d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:12.122261 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-909bea17-6702-48b8-9104-2cb7d61d492d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:12.137126 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-909bea17-6702-48b8-9104-2cb7d61d492d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:12.138302 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-909bea17-6702-48b8-9104-2cb7d61d492d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:12.139177 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-909bea17-6702-48b8-9104-2cb7d61d492d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:12.139626 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-909bea17-6702-48b8-9104-2cb7d61d492d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:12.522780 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-37025205-5e88-4a19-b60c-1367d9d01d23 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:12.558536 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-37025205-5e88-4a19-b60c-1367d9d01d23 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1315 microversion: 2.1 time: 0.761846 Nov 16 00:29:12.562602 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 31/68] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:11 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1315 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:12.582411 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3c51eddf-dcba-4c7f-b270-b4cafc923ce7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:12.585906 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3c51eddf-dcba-4c7f-b270-b4cafc923ce7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:12.605140 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3c51eddf-dcba-4c7f-b270-b4cafc923ce7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:12.615460 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3c51eddf-dcba-4c7f-b270-b4cafc923ce7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:12.617825 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3c51eddf-dcba-4c7f-b270-b4cafc923ce7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:12.621595 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3c51eddf-dcba-4c7f-b270-b4cafc923ce7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:12.829931 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3c51eddf-dcba-4c7f-b270-b4cafc923ce7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:12.859719 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3c51eddf-dcba-4c7f-b270-b4cafc923ce7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:12.862969 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3c51eddf-dcba-4c7f-b270-b4cafc923ce7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:12.873242 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-3c51eddf-dcba-4c7f-b270-b4cafc923ce7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1339 microversion: 2.20 time: 0.296443 Nov 16 00:29:12.877700 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 32/69] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:29:12 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1339 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:29:12.932674 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-06bbcb4f-f45e-4548-baf3-695f8e7e8a7a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1115095423", "imageRef": "bb47ca05-3b48-4f1c-bc96-e0c5c672caba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3262426f-7c77-4fea-b32e-ea6229d56ca5"}], "security_groups": [{"name": "tempest-securitygroup--404386992"}], "key_name": "tempest-keypair-128653493", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:12.980093 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-909bea17-6702-48b8-9104-2cb7d61d492d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:12.993747 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-909bea17-6702-48b8-9104-2cb7d61d492d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1322 microversion: 2.1 time: 0.877875 Nov 16 00:29:12.994181 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 38/70] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:12 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1322 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:13.284281 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.network.neutron [None req-06bbcb4f-f45e-4548-baf3-695f8e7e8a7a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] validate_networks() for [('3262426f-7c77-4fea-b32e-ea6229d56ca5', None, None, None, None, None)] {{(pid=122544) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:29:13.590467 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-634ec328-b3b8-4399-b338-9d45f7be32d5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:13.591258 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-634ec328-b3b8-4399-b338-9d45f7be32d5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:13.606774 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-634ec328-b3b8-4399-b338-9d45f7be32d5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:13.607551 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-634ec328-b3b8-4399-b338-9d45f7be32d5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:13.608524 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-634ec328-b3b8-4399-b338-9d45f7be32d5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:13.609064 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-634ec328-b3b8-4399-b338-9d45f7be32d5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:14.237287 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-634ec328-b3b8-4399-b338-9d45f7be32d5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:14.247636 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-634ec328-b3b8-4399-b338-9d45f7be32d5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1315 microversion: 2.1 time: 0.661200 Nov 16 00:29:14.259424 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 39/71] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:13 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1315 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:14.265840 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-30bbb959-b455-4186-9d5c-321ca8afbd6e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:14.269843 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-30bbb959-b455-4186-9d5c-321ca8afbd6e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:14.276981 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-30bbb959-b455-4186-9d5c-321ca8afbd6e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:14.278213 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-30bbb959-b455-4186-9d5c-321ca8afbd6e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:14.279894 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-30bbb959-b455-4186-9d5c-321ca8afbd6e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:14.280722 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-30bbb959-b455-4186-9d5c-321ca8afbd6e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:15.017681 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-30bbb959-b455-4186-9d5c-321ca8afbd6e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:15.051731 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-30bbb959-b455-4186-9d5c-321ca8afbd6e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:15.066987 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-30bbb959-b455-4186-9d5c-321ca8afbd6e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:15.078807 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-30bbb959-b455-4186-9d5c-321ca8afbd6e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1405 microversion: 2.20 time: 0.817030 Nov 16 00:29:15.085453 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 40/72] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:29:14 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1405 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:29:15.103745 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-4dce5106-1112-4458-95aa-fbb38b1ca176 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:15.110285 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-4dce5106-1112-4458-95aa-fbb38b1ca176 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:15.155444 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4dce5106-1112-4458-95aa-fbb38b1ca176 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:15.156251 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4dce5106-1112-4458-95aa-fbb38b1ca176 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:15.158127 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4dce5106-1112-4458-95aa-fbb38b1ca176 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:15.158848 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4dce5106-1112-4458-95aa-fbb38b1ca176 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:15.741977 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-06bbcb4f-f45e-4548-baf3-695f8e7e8a7a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Flavor limits 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:29:15.742563 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-06bbcb4f-f45e-4548-baf3-695f8e7e8a7a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Image limits 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:29:15.742933 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-06bbcb4f-f45e-4548-baf3-695f8e7e8a7a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Flavor pref 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:29:15.743212 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-4dce5106-1112-4458-95aa-fbb38b1ca176 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:15.743462 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-06bbcb4f-f45e-4548-baf3-695f8e7e8a7a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Image pref 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:29:15.743889 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-06bbcb4f-f45e-4548-baf3-695f8e7e8a7a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:29:15.771076 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-06bbcb4f-f45e-4548-baf3-695f8e7e8a7a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:15.775545 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-06bbcb4f-f45e-4548-baf3-695f8e7e8a7a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:15.778110 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-06bbcb4f-f45e-4548-baf3-695f8e7e8a7a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:15.780652 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-06bbcb4f-f45e-4548-baf3-695f8e7e8a7a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:15.820845 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-4dce5106-1112-4458-95aa-fbb38b1ca176 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1322 microversion: 2.1 time: 0.730428 Nov 16 00:29:15.831366 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 41/73] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:15 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1322 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:15.883490 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-06bbcb4f-f45e-4548-baf3-695f8e7e8a7a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Getting quotas for project a0f2408fc1d043e581cf3406f493b307. Resources: {'instances', 'cores', 'ram'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:29:15.900888 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-06bbcb4f-f45e-4548-baf3-695f8e7e8a7a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Getting quotas for user 722e3d22cb754e55aec75f2b8b24ca19 and project a0f2408fc1d043e581cf3406f493b307. Resources: {'instances', 'cores', 'ram'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:29:15.939668 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-06bbcb4f-f45e-4548-baf3-695f8e7e8a7a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Going to run 1 instances... {{(pid=122544) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:29:15.944204 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-06bbcb4f-f45e-4548-baf3-695f8e7e8a7a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb47ca05-3b48-4f1c-bc96-e0c5c672caba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:29:16.057770 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-06bbcb4f-f45e-4548-baf3-695f8e7e8a7a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.136323 Nov 16 00:29:16.060234 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 33/74] 10.222.0.31 () {60 vars in 1146 bytes} [Tue Nov 16 00:29:12 2021] POST /compute/v2.1/servers => generated 401 bytes in 3140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 16 00:29:16.070901 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-4f88187c-f21a-4bf9-a9d4-9641f0ccc41b tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:16.072942 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-4f88187c-f21a-4bf9-a9d4-9641f0ccc41b tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:16.089239 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4f88187c-f21a-4bf9-a9d4-9641f0ccc41b tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:16.092029 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4f88187c-f21a-4bf9-a9d4-9641f0ccc41b tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:16.095535 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4f88187c-f21a-4bf9-a9d4-9641f0ccc41b tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:16.096301 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4f88187c-f21a-4bf9-a9d4-9641f0ccc41b tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:16.185491 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-74286173-1953-407c-b526-a3c6a50cc828 req-1338328e-21d8-462e-8365-86ceee8ca3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9fc982a-6c0b-4489-8e17-7be77c13ddaf", "tag": "cce90d18-c28e-4785-a1d3-e0ca956a9084"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:16.188955 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:29:16.188955 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:29:16.243846 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-74286173-1953-407c-b526-a3c6a50cc828 req-1338328e-21d8-462e-8365-86ceee8ca3d7 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:16.244631 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-74286173-1953-407c-b526-a3c6a50cc828 req-1338328e-21d8-462e-8365-86ceee8ca3d7 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:16.295213 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-74286173-1953-407c-b526-a3c6a50cc828 req-1338328e-21d8-462e-8365-86ceee8ca3d7 service nova] Creating event network-changed:cce90d18-c28e-4785-a1d3-e0ca956a9084 for instance e9fc982a-6c0b-4489-8e17-7be77c13ddaf on hv-cinder-81115 Nov 16 00:29:16.303354 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-74286173-1953-407c-b526-a3c6a50cc828 req-1338328e-21d8-462e-8365-86ceee8ca3d7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.474941 Nov 16 00:29:16.305014 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 42/75] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:29:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:29:16.313077 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-0ba59033-f2df-462c-82a8-dc7de4ee109e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:16.314252 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-0ba59033-f2df-462c-82a8-dc7de4ee109e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:16.326009 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-4f88187c-f21a-4bf9-a9d4-9641f0ccc41b tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:16.337624 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-4f88187c-f21a-4bf9-a9d4-9641f0ccc41b tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1502 microversion: 2.1 time: 0.275823 Nov 16 00:29:16.338370 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 34/76] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:16 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1502 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:16.354980 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e91c3469-1a86-4c09-a96a-7f98aab63284 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:16.355623 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e91c3469-1a86-4c09-a96a-7f98aab63284 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:16.366637 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e91c3469-1a86-4c09-a96a-7f98aab63284 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:16.369979 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e91c3469-1a86-4c09-a96a-7f98aab63284 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:16.371000 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e91c3469-1a86-4c09-a96a-7f98aab63284 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:16.371589 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e91c3469-1a86-4c09-a96a-7f98aab63284 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:16.457044 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-0ba59033-f2df-462c-82a8-dc7de4ee109e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:16.467550 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-0ba59033-f2df-462c-82a8-dc7de4ee109e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1237 microversion: 2.1 time: 0.160490 Nov 16 00:29:16.468718 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 43/77] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:16 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1237 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:16.679220 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e91c3469-1a86-4c09-a96a-7f98aab63284 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:16.731491 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e91c3469-1a86-4c09-a96a-7f98aab63284 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:16.737067 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e91c3469-1a86-4c09-a96a-7f98aab63284 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:16.740392 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e91c3469-1a86-4c09-a96a-7f98aab63284 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1405 microversion: 2.20 time: 0.400104 Nov 16 00:29:16.745432 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 35/78] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:29:16 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:29:16.840199 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-d251e692-4e8e-4e19-b4ec-78d7a180b845 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:16.840967 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d251e692-4e8e-4e19-b4ec-78d7a180b845 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:16.854961 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d251e692-4e8e-4e19-b4ec-78d7a180b845 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:16.859350 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d251e692-4e8e-4e19-b4ec-78d7a180b845 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:16.861590 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d251e692-4e8e-4e19-b4ec-78d7a180b845 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:16.862021 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d251e692-4e8e-4e19-b4ec-78d7a180b845 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:17.300688 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-89363df7-2659-4786-b166-9e52e1c88b09 req-baa4000c-191b-4d8d-a340-da68f997cf55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f9b823f-75c2-4baf-9577-5dc85ec77405", "tag": "10abc4a6-a723-4a5c-855b-11d4b6d40eb9"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:17.302499 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:29:17.302499 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:29:17.318542 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-89363df7-2659-4786-b166-9e52e1c88b09 req-baa4000c-191b-4d8d-a340-da68f997cf55 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:17.318963 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-89363df7-2659-4786-b166-9e52e1c88b09 req-baa4000c-191b-4d8d-a340-da68f997cf55 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:17.363324 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-89363df7-2659-4786-b166-9e52e1c88b09 req-baa4000c-191b-4d8d-a340-da68f997cf55 service nova] Creating event network-changed:10abc4a6-a723-4a5c-855b-11d4b6d40eb9 for instance 3f9b823f-75c2-4baf-9577-5dc85ec77405 on hv-cinder-81115 Nov 16 00:29:17.375142 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-89363df7-2659-4786-b166-9e52e1c88b09 req-baa4000c-191b-4d8d-a340-da68f997cf55 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077713 Nov 16 00:29:17.375760 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 36/79] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:29:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:29:17.463428 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-d251e692-4e8e-4e19-b4ec-78d7a180b845 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:17.480918 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-d251e692-4e8e-4e19-b4ec-78d7a180b845 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1322 microversion: 2.1 time: 0.644839 Nov 16 00:29:17.482411 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 44/80] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:16 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1322 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:17.488614 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-5a55b503-f8e5-4f65-875d-e5c78d352bef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:17.489560 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-5a55b503-f8e5-4f65-875d-e5c78d352bef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:17.504638 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5a55b503-f8e5-4f65-875d-e5c78d352bef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:17.505078 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5a55b503-f8e5-4f65-875d-e5c78d352bef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:17.505893 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5a55b503-f8e5-4f65-875d-e5c78d352bef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:17.506315 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5a55b503-f8e5-4f65-875d-e5c78d352bef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:17.613068 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-5a55b503-f8e5-4f65-875d-e5c78d352bef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:17.630639 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-5a55b503-f8e5-4f65-875d-e5c78d352bef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1241 microversion: 2.1 time: 0.146153 Nov 16 00:29:17.632225 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 37/81] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:17 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1241 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:17.782607 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-5f068268-e672-4682-9a5c-fa1a8380d696 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:17.785664 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-5f068268-e672-4682-9a5c-fa1a8380d696 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:17.797520 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5f068268-e672-4682-9a5c-fa1a8380d696 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:17.798394 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5f068268-e672-4682-9a5c-fa1a8380d696 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:17.800003 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5f068268-e672-4682-9a5c-fa1a8380d696 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:17.801054 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5f068268-e672-4682-9a5c-fa1a8380d696 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:18.058531 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-5f068268-e672-4682-9a5c-fa1a8380d696 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:18.076896 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-5f068268-e672-4682-9a5c-fa1a8380d696 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:18.079189 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-5f068268-e672-4682-9a5c-fa1a8380d696 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:18.082631 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-5f068268-e672-4682-9a5c-fa1a8380d696 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1405 microversion: 2.20 time: 0.308961 Nov 16 00:29:18.098884 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 45/82] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:29:17 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1405 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:29:18.510400 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-dc4b6aec-3c2c-4f14-9fcf-2bed0bb98ae0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:18.512114 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-dc4b6aec-3c2c-4f14-9fcf-2bed0bb98ae0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:18.530088 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dc4b6aec-3c2c-4f14-9fcf-2bed0bb98ae0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:18.530621 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dc4b6aec-3c2c-4f14-9fcf-2bed0bb98ae0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:18.531540 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dc4b6aec-3c2c-4f14-9fcf-2bed0bb98ae0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:18.532029 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dc4b6aec-3c2c-4f14-9fcf-2bed0bb98ae0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:18.654140 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-d9082956-2fff-4b1a-b486-a34ddfb9a243 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:18.656576 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d9082956-2fff-4b1a-b486-a34ddfb9a243 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:18.669765 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d9082956-2fff-4b1a-b486-a34ddfb9a243 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:18.670662 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d9082956-2fff-4b1a-b486-a34ddfb9a243 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:18.672898 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d9082956-2fff-4b1a-b486-a34ddfb9a243 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:18.674164 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d9082956-2fff-4b1a-b486-a34ddfb9a243 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:18.787742 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-d9082956-2fff-4b1a-b486-a34ddfb9a243 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:18.803829 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-d9082956-2fff-4b1a-b486-a34ddfb9a243 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1241 microversion: 2.1 time: 0.156237 Nov 16 00:29:18.805234 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 46/83] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:18 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1241 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:18.808566 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-dc4b6aec-3c2c-4f14-9fcf-2bed0bb98ae0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:18.823484 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-dc4b6aec-3c2c-4f14-9fcf-2bed0bb98ae0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1322 microversion: 2.1 time: 0.316403 Nov 16 00:29:18.824646 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 38/84] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:18 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:19.119478 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-bc63eb67-aeb9-4cc8-b85e-ef789f580d4e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:19.125394 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-bc63eb67-aeb9-4cc8-b85e-ef789f580d4e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:19.135651 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bc63eb67-aeb9-4cc8-b85e-ef789f580d4e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:19.137131 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bc63eb67-aeb9-4cc8-b85e-ef789f580d4e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:19.141303 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bc63eb67-aeb9-4cc8-b85e-ef789f580d4e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:19.142826 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bc63eb67-aeb9-4cc8-b85e-ef789f580d4e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:19.514791 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-7979d8a1-c2a1-4b20-94d3-51d898e69c0f tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29da15b4-12c9-4ea0-bfc4-b7bf9f59ccb3"}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:19.520776 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-7979d8a1-c2a1-4b20-94d3-51d898e69c0f tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:19.538434 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7979d8a1-c2a1-4b20-94d3-51d898e69c0f tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:19.539236 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7979d8a1-c2a1-4b20-94d3-51d898e69c0f tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:19.540851 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7979d8a1-c2a1-4b20-94d3-51d898e69c0f tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:19.541605 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7979d8a1-c2a1-4b20-94d3-51d898e69c0f tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:20.489398 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-bc63eb67-aeb9-4cc8-b85e-ef789f580d4e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:20.529100 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-bc63eb67-aeb9-4cc8-b85e-ef789f580d4e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:20.539029 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-bc63eb67-aeb9-4cc8-b85e-ef789f580d4e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:20.545294 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-bc63eb67-aeb9-4cc8-b85e-ef789f580d4e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1405 microversion: 2.20 time: 1.431397 Nov 16 00:29:20.570762 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 47/85] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:29:19 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1405 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:29:20.578499 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-411fe9b2-7518-46d1-9d57-1fcab9b0daae tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:20.579569 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-411fe9b2-7518-46d1-9d57-1fcab9b0daae tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:20.590588 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-411fe9b2-7518-46d1-9d57-1fcab9b0daae tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:20.591565 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-411fe9b2-7518-46d1-9d57-1fcab9b0daae tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:20.593087 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-411fe9b2-7518-46d1-9d57-1fcab9b0daae tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:20.594050 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-411fe9b2-7518-46d1-9d57-1fcab9b0daae tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:20.774636 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-7979d8a1-c2a1-4b20-94d3-51d898e69c0f tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "POST /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.266427 Nov 16 00:29:20.775900 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 39/86] 10.222.0.31 () {60 vars in 1322 bytes} [Tue Nov 16 00:29:19 2021] POST /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac/os-volume_attachments => generated 194 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:29:20.787206 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a9a18873-fc1b-4109-81b4-dd6046f45e00 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:20.788975 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a9a18873-fc1b-4109-81b4-dd6046f45e00 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:20.801876 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a9a18873-fc1b-4109-81b4-dd6046f45e00 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:20.802789 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a9a18873-fc1b-4109-81b4-dd6046f45e00 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:20.804485 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a9a18873-fc1b-4109-81b4-dd6046f45e00 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:20.805618 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a9a18873-fc1b-4109-81b4-dd6046f45e00 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:21.127130 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-411fe9b2-7518-46d1-9d57-1fcab9b0daae tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:21.140250 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-411fe9b2-7518-46d1-9d57-1fcab9b0daae tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1295 microversion: 2.1 time: 0.567974 Nov 16 00:29:21.142974 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 48/87] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:20 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1295 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:21.456991 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a9a18873-fc1b-4109-81b4-dd6046f45e00 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:21.464878 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-83152786-fae5-4ceb-bcbe-395f9b8dd3b0 req-43ab0624-8df3-4443-a662-8975629d47ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "896600e3-829b-43f9-87af-60d271f05432", "name": "network-vif-plugged", "status": "completed", "tag": "c1f88a1d-9b68-4cbe-84d4-91309b1307d6"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:21.466551 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:29:21.466551 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:29:21.485629 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a9a18873-fc1b-4109-81b4-dd6046f45e00 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1322 microversion: 2.1 time: 0.707209 Nov 16 00:29:21.487023 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 40/88] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:20 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1322 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:21.500869 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-83152786-fae5-4ceb-bcbe-395f9b8dd3b0 req-43ab0624-8df3-4443-a662-8975629d47ad service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:21.501683 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-83152786-fae5-4ceb-bcbe-395f9b8dd3b0 req-43ab0624-8df3-4443-a662-8975629d47ad service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:21.528323 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-83152786-fae5-4ceb-bcbe-395f9b8dd3b0 req-43ab0624-8df3-4443-a662-8975629d47ad service nova] Creating event network-vif-plugged:c1f88a1d-9b68-4cbe-84d4-91309b1307d6 for instance 896600e3-829b-43f9-87af-60d271f05432 on hv-cinder-81115 Nov 16 00:29:21.541239 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-83152786-fae5-4ceb-bcbe-395f9b8dd3b0 req-43ab0624-8df3-4443-a662-8975629d47ad service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073868 Nov 16 00:29:21.542701 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 49/89] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:29:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:29:21.584553 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-17ae0127-24e9-43c8-a7f3-162a3175693c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:21.585988 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-17ae0127-24e9-43c8-a7f3-162a3175693c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:21.618487 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-17ae0127-24e9-43c8-a7f3-162a3175693c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:21.619637 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-17ae0127-24e9-43c8-a7f3-162a3175693c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:21.621297 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-17ae0127-24e9-43c8-a7f3-162a3175693c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:21.621839 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-17ae0127-24e9-43c8-a7f3-162a3175693c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:21.970168 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-17ae0127-24e9-43c8-a7f3-162a3175693c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:21.999804 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-17ae0127-24e9-43c8-a7f3-162a3175693c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:22.004336 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-17ae0127-24e9-43c8-a7f3-162a3175693c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:22.006015 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-17ae0127-24e9-43c8-a7f3-162a3175693c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1405 microversion: 2.20 time: 0.430890 Nov 16 00:29:22.007071 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 41/90] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:29:21 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1405 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:29:22.173891 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-660e8417-7499-42a0-be34-53d349b702a1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:22.175657 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-660e8417-7499-42a0-be34-53d349b702a1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:22.185205 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-660e8417-7499-42a0-be34-53d349b702a1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:22.185940 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-660e8417-7499-42a0-be34-53d349b702a1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:22.187239 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-660e8417-7499-42a0-be34-53d349b702a1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:22.187964 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-660e8417-7499-42a0-be34-53d349b702a1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:22.287411 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-660e8417-7499-42a0-be34-53d349b702a1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:22.295575 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-660e8417-7499-42a0-be34-53d349b702a1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1295 microversion: 2.1 time: 0.128153 Nov 16 00:29:22.296647 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 50/91] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:22 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1295 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:22.509076 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-92c16ac3-13ff-47ff-b7f4-0845292d43d1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:22.510095 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-92c16ac3-13ff-47ff-b7f4-0845292d43d1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:22.521076 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-92c16ac3-13ff-47ff-b7f4-0845292d43d1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:22.521676 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-92c16ac3-13ff-47ff-b7f4-0845292d43d1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:22.523099 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-92c16ac3-13ff-47ff-b7f4-0845292d43d1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:22.524064 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-92c16ac3-13ff-47ff-b7f4-0845292d43d1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:22.719342 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-92c16ac3-13ff-47ff-b7f4-0845292d43d1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:22.728433 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-92c16ac3-13ff-47ff-b7f4-0845292d43d1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1322 microversion: 2.1 time: 0.226154 Nov 16 00:29:22.731506 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 42/92] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:22 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:23.026697 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-56051503-a228-414e-9bb7-907b9c9123a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:23.027981 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-56051503-a228-414e-9bb7-907b9c9123a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:23.034797 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-56051503-a228-414e-9bb7-907b9c9123a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:23.035800 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-56051503-a228-414e-9bb7-907b9c9123a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:23.036708 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-56051503-a228-414e-9bb7-907b9c9123a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:23.037186 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-56051503-a228-414e-9bb7-907b9c9123a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:23.213380 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-56051503-a228-414e-9bb7-907b9c9123a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:23.225249 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-56051503-a228-414e-9bb7-907b9c9123a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:23.226757 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-56051503-a228-414e-9bb7-907b9c9123a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:23.227961 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-56051503-a228-414e-9bb7-907b9c9123a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1405 microversion: 2.20 time: 0.205636 Nov 16 00:29:23.239722 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 51/93] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:29:23 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:29:23.322649 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-36541e8c-a26f-4652-9672-8b06ce316d3c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:23.325173 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-36541e8c-a26f-4652-9672-8b06ce316d3c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:23.340272 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-36541e8c-a26f-4652-9672-8b06ce316d3c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:23.341098 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-36541e8c-a26f-4652-9672-8b06ce316d3c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:23.343241 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-36541e8c-a26f-4652-9672-8b06ce316d3c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:23.344371 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-36541e8c-a26f-4652-9672-8b06ce316d3c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:23.426758 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-36541e8c-a26f-4652-9672-8b06ce316d3c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:23.436771 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-36541e8c-a26f-4652-9672-8b06ce316d3c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1295 microversion: 2.1 time: 0.123842 Nov 16 00:29:23.437502 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 43/94] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:23 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1295 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:23.746274 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-06f7727e-9c5c-4553-baa6-427604637c9b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:23.746916 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-06f7727e-9c5c-4553-baa6-427604637c9b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:23.754997 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-06f7727e-9c5c-4553-baa6-427604637c9b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:23.755798 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-06f7727e-9c5c-4553-baa6-427604637c9b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:23.756876 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-06f7727e-9c5c-4553-baa6-427604637c9b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:23.757279 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-06f7727e-9c5c-4553-baa6-427604637c9b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:24.252650 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-ed833369-f57f-43af-b2ed-9310d8818d76 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:24.254274 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-ed833369-f57f-43af-b2ed-9310d8818d76 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:24.272324 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ed833369-f57f-43af-b2ed-9310d8818d76 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:24.273402 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ed833369-f57f-43af-b2ed-9310d8818d76 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:24.277057 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ed833369-f57f-43af-b2ed-9310d8818d76 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:24.278095 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ed833369-f57f-43af-b2ed-9310d8818d76 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:24.296884 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-06f7727e-9c5c-4553-baa6-427604637c9b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:24.320438 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-06f7727e-9c5c-4553-baa6-427604637c9b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1322 microversion: 2.1 time: 0.576520 Nov 16 00:29:24.326373 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 52/95] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:23 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1322 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:24.455854 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8d69d42b-296f-4527-bc0b-52b56afa5ffc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:24.457544 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8d69d42b-296f-4527-bc0b-52b56afa5ffc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:24.466151 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8d69d42b-296f-4527-bc0b-52b56afa5ffc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:24.466896 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8d69d42b-296f-4527-bc0b-52b56afa5ffc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:24.467914 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8d69d42b-296f-4527-bc0b-52b56afa5ffc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:24.468512 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8d69d42b-296f-4527-bc0b-52b56afa5ffc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:24.631714 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-8d69d42b-296f-4527-bc0b-52b56afa5ffc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:24.668212 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-ed833369-f57f-43af-b2ed-9310d8818d76 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:24.681520 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8d69d42b-296f-4527-bc0b-52b56afa5ffc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1295 microversion: 2.1 time: 0.230687 Nov 16 00:29:24.689066 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 53/96] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:24 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1295 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:24.700074 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-ed833369-f57f-43af-b2ed-9310d8818d76 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:24.703690 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-ed833369-f57f-43af-b2ed-9310d8818d76 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:24.706386 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-ed833369-f57f-43af-b2ed-9310d8818d76 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1405 microversion: 2.20 time: 0.457709 Nov 16 00:29:24.708048 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 44/97] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:29:24 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:29:25.363476 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1b060c43-109f-4a1b-875f-eaf517f11a86 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:25.367626 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1b060c43-109f-4a1b-875f-eaf517f11a86 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:25.398349 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1b060c43-109f-4a1b-875f-eaf517f11a86 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:25.399104 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1b060c43-109f-4a1b-875f-eaf517f11a86 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:25.400482 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1b060c43-109f-4a1b-875f-eaf517f11a86 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:25.401219 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1b060c43-109f-4a1b-875f-eaf517f11a86 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:25.714805 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e2d64de9-a62d-4f9e-bf83-93ecc20016c8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:25.718918 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e2d64de9-a62d-4f9e-bf83-93ecc20016c8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:25.736070 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e2d64de9-a62d-4f9e-bf83-93ecc20016c8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:25.737617 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e2d64de9-a62d-4f9e-bf83-93ecc20016c8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:25.739987 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e2d64de9-a62d-4f9e-bf83-93ecc20016c8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:25.741474 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e2d64de9-a62d-4f9e-bf83-93ecc20016c8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:25.866463 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-1b060c43-109f-4a1b-875f-eaf517f11a86 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:25.891822 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-1b060c43-109f-4a1b-875f-eaf517f11a86 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1322 microversion: 2.1 time: 0.536928 Nov 16 00:29:25.896800 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 54/98] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:25 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:25.905537 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f200bb30-b8c2-41b6-aa0b-a49a4e23e278 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:25.916724 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f200bb30-b8c2-41b6-aa0b-a49a4e23e278 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:25.929456 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f200bb30-b8c2-41b6-aa0b-a49a4e23e278 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:25.930400 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f200bb30-b8c2-41b6-aa0b-a49a4e23e278 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:25.932301 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f200bb30-b8c2-41b6-aa0b-a49a4e23e278 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:25.933256 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f200bb30-b8c2-41b6-aa0b-a49a4e23e278 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:26.137742 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e2d64de9-a62d-4f9e-bf83-93ecc20016c8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:26.169653 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e2d64de9-a62d-4f9e-bf83-93ecc20016c8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1362 microversion: 2.1 time: 0.465370 Nov 16 00:29:26.170943 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 45/99] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:25 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1362 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:26.306323 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f200bb30-b8c2-41b6-aa0b-a49a4e23e278 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:26.336034 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f200bb30-b8c2-41b6-aa0b-a49a4e23e278 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:26.358729 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f200bb30-b8c2-41b6-aa0b-a49a4e23e278 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:26.358729 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f200bb30-b8c2-41b6-aa0b-a49a4e23e278 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1405 microversion: 2.20 time: 0.457486 Nov 16 00:29:26.358729 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 55/100] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:29:25 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:29:26.497723 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-053bf811-1a51-49bb-8d85-47cc77a5651b req-fee6b671-d1a2-4983-96ba-0fbc13a86ecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f376e4-af26-4799-9127-58d9efd50cdc", "tag": "01184432-b920-416d-948c-2998a3138394"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:26.501046 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:29:26.501046 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:29:26.530727 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-053bf811-1a51-49bb-8d85-47cc77a5651b req-fee6b671-d1a2-4983-96ba-0fbc13a86ecb service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:26.532521 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-053bf811-1a51-49bb-8d85-47cc77a5651b req-fee6b671-d1a2-4983-96ba-0fbc13a86ecb service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:26.590454 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-053bf811-1a51-49bb-8d85-47cc77a5651b req-fee6b671-d1a2-4983-96ba-0fbc13a86ecb service nova] Creating event network-changed:01184432-b920-416d-948c-2998a3138394 for instance d6f376e4-af26-4799-9127-58d9efd50cdc on hv-cinder-81115 Nov 16 00:29:26.630707 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-053bf811-1a51-49bb-8d85-47cc77a5651b req-fee6b671-d1a2-4983-96ba-0fbc13a86ecb service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149951 Nov 16 00:29:26.636436 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 46/101] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:29:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:29:26.930193 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8bd7c9be-06e8-408f-ae77-f620dca6fb45 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:26.936482 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8bd7c9be-06e8-408f-ae77-f620dca6fb45 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:26.957781 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8bd7c9be-06e8-408f-ae77-f620dca6fb45 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:26.959218 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8bd7c9be-06e8-408f-ae77-f620dca6fb45 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:26.961150 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8bd7c9be-06e8-408f-ae77-f620dca6fb45 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:26.962381 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8bd7c9be-06e8-408f-ae77-f620dca6fb45 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:27.193401 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-95603abf-45fe-433e-9f87-d548b186fe8b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:27.196319 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-95603abf-45fe-433e-9f87-d548b186fe8b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:27.208929 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-95603abf-45fe-433e-9f87-d548b186fe8b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:27.210154 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-95603abf-45fe-433e-9f87-d548b186fe8b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:27.211934 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-95603abf-45fe-433e-9f87-d548b186fe8b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:27.213048 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-95603abf-45fe-433e-9f87-d548b186fe8b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:27.320316 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-8bd7c9be-06e8-408f-ae77-f620dca6fb45 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:27.368025 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8bd7c9be-06e8-408f-ae77-f620dca6fb45 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1322 microversion: 2.1 time: 0.447711 Nov 16 00:29:27.368643 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 56/102] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:26 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1322 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:27.377817 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1f6abbb7-b568-45b5-a4d2-3e0cc0fcc80c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:27.378436 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1f6abbb7-b568-45b5-a4d2-3e0cc0fcc80c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:27.390916 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1f6abbb7-b568-45b5-a4d2-3e0cc0fcc80c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:27.391685 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1f6abbb7-b568-45b5-a4d2-3e0cc0fcc80c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:27.392667 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1f6abbb7-b568-45b5-a4d2-3e0cc0fcc80c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:27.393102 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1f6abbb7-b568-45b5-a4d2-3e0cc0fcc80c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:27.676658 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-1f6abbb7-b568-45b5-a4d2-3e0cc0fcc80c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:27.694083 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-1f6abbb7-b568-45b5-a4d2-3e0cc0fcc80c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:27.698502 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-1f6abbb7-b568-45b5-a4d2-3e0cc0fcc80c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:27.702796 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-1f6abbb7-b568-45b5-a4d2-3e0cc0fcc80c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1405 microversion: 2.20 time: 0.327441 Nov 16 00:29:27.705225 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 57/103] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:29:27 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1405 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:29:27.750105 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-8173ab9b-ca74-49f5-810d-d7efadf219d2 req-e5ecac86-44cf-480f-ba30-d31f35aaed61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fc982a-6c0b-4489-8e17-7be77c13ddaf", "name": "network-vif-plugged", "status": "completed", "tag": "cce90d18-c28e-4785-a1d3-e0ca956a9084"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:27.752613 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:29:27.752613 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:29:27.795130 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-8173ab9b-ca74-49f5-810d-d7efadf219d2 req-e5ecac86-44cf-480f-ba30-d31f35aaed61 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:27.799276 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-8173ab9b-ca74-49f5-810d-d7efadf219d2 req-e5ecac86-44cf-480f-ba30-d31f35aaed61 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:27.839387 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-8173ab9b-ca74-49f5-810d-d7efadf219d2 req-e5ecac86-44cf-480f-ba30-d31f35aaed61 service nova] Creating event network-vif-plugged:cce90d18-c28e-4785-a1d3-e0ca956a9084 for instance e9fc982a-6c0b-4489-8e17-7be77c13ddaf on hv-cinder-81115 Nov 16 00:29:27.855768 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-8173ab9b-ca74-49f5-810d-d7efadf219d2 req-e5ecac86-44cf-480f-ba30-d31f35aaed61 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115310 Nov 16 00:29:27.858141 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 58/104] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:29:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:29:27.883272 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-95603abf-45fe-433e-9f87-d548b186fe8b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:27.919011 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-95603abf-45fe-433e-9f87-d548b186fe8b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1362 microversion: 2.1 time: 0.731824 Nov 16 00:29:27.919704 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 47/105] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:27 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1362 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:28.397537 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-3c2ea9ea-6eea-45ad-9ddc-59619d5530c0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:28.398272 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-3c2ea9ea-6eea-45ad-9ddc-59619d5530c0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:28.413256 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3c2ea9ea-6eea-45ad-9ddc-59619d5530c0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:28.414130 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3c2ea9ea-6eea-45ad-9ddc-59619d5530c0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:28.416119 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3c2ea9ea-6eea-45ad-9ddc-59619d5530c0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:28.416796 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3c2ea9ea-6eea-45ad-9ddc-59619d5530c0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:28.600501 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-3c2ea9ea-6eea-45ad-9ddc-59619d5530c0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:28.609148 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-3c2ea9ea-6eea-45ad-9ddc-59619d5530c0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1322 microversion: 2.1 time: 0.217677 Nov 16 00:29:28.615436 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 59/106] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:28 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:28.729670 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a9684a7a-ab63-4c92-bfe0-6e93d49a0b96 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:28.730833 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a9684a7a-ab63-4c92-bfe0-6e93d49a0b96 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:28.742849 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a9684a7a-ab63-4c92-bfe0-6e93d49a0b96 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:28.743792 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a9684a7a-ab63-4c92-bfe0-6e93d49a0b96 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:28.745324 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a9684a7a-ab63-4c92-bfe0-6e93d49a0b96 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:28.746230 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a9684a7a-ab63-4c92-bfe0-6e93d49a0b96 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:28.940023 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-a6e8f8a7-15bf-4a47-9c0f-138d4568fd74 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:28.940698 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-a6e8f8a7-15bf-4a47-9c0f-138d4568fd74 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:28.958134 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a6e8f8a7-15bf-4a47-9c0f-138d4568fd74 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:28.958441 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a6e8f8a7-15bf-4a47-9c0f-138d4568fd74 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:28.959348 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a6e8f8a7-15bf-4a47-9c0f-138d4568fd74 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:28.962591 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a6e8f8a7-15bf-4a47-9c0f-138d4568fd74 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:29.157981 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a9684a7a-ab63-4c92-bfe0-6e93d49a0b96 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:29.175606 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a9684a7a-ab63-4c92-bfe0-6e93d49a0b96 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:29.179973 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a9684a7a-ab63-4c92-bfe0-6e93d49a0b96 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:29.182800 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-a6e8f8a7-15bf-4a47-9c0f-138d4568fd74 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:29.183782 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a9684a7a-ab63-4c92-bfe0-6e93d49a0b96 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1405 microversion: 2.20 time: 0.458558 Nov 16 00:29:29.185050 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 48/107] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:29:28 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:29:29.204088 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-a6e8f8a7-15bf-4a47-9c0f-138d4568fd74 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1362 microversion: 2.1 time: 0.266465 Nov 16 00:29:29.208868 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 60/108] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:28 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:29.641285 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-bd89347e-3055-45fd-9e59-05011fcfc263 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:29.642353 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-bd89347e-3055-45fd-9e59-05011fcfc263 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:29.653076 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bd89347e-3055-45fd-9e59-05011fcfc263 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:29.653923 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bd89347e-3055-45fd-9e59-05011fcfc263 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:29.655090 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bd89347e-3055-45fd-9e59-05011fcfc263 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:29.655898 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bd89347e-3055-45fd-9e59-05011fcfc263 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:30.091724 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-bd89347e-3055-45fd-9e59-05011fcfc263 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:30.101906 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-bd89347e-3055-45fd-9e59-05011fcfc263 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1322 microversion: 2.1 time: 0.471341 Nov 16 00:29:30.103268 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 49/109] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:29 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1322 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:30.217515 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-e9e39267-5208-4d29-bd76-c011867823c1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:30.218692 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-e9e39267-5208-4d29-bd76-c011867823c1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:30.225510 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e14e20b0-c81f-4a33-94bd-4c745e8377a0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:30.226128 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e14e20b0-c81f-4a33-94bd-4c745e8377a0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:30.239135 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e14e20b0-c81f-4a33-94bd-4c745e8377a0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:30.239669 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e14e20b0-c81f-4a33-94bd-4c745e8377a0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:30.240401 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e14e20b0-c81f-4a33-94bd-4c745e8377a0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:30.240834 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e14e20b0-c81f-4a33-94bd-4c745e8377a0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:30.244232 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e9e39267-5208-4d29-bd76-c011867823c1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:30.249441 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e9e39267-5208-4d29-bd76-c011867823c1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:30.250823 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e9e39267-5208-4d29-bd76-c011867823c1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:30.251607 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e9e39267-5208-4d29-bd76-c011867823c1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:30.562422 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e14e20b0-c81f-4a33-94bd-4c745e8377a0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:30.582834 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e14e20b0-c81f-4a33-94bd-4c745e8377a0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1362 microversion: 2.1 time: 0.360649 Nov 16 00:29:30.599853 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 50/110] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:30 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1362 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:31.137531 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-1bd59156-7355-4aa4-a204-eb503ef20e36 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:31.138595 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-1bd59156-7355-4aa4-a204-eb503ef20e36 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:31.147398 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e9e39267-5208-4d29-bd76-c011867823c1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:31.169667 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1bd59156-7355-4aa4-a204-eb503ef20e36 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:31.170466 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1bd59156-7355-4aa4-a204-eb503ef20e36 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:31.171923 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1bd59156-7355-4aa4-a204-eb503ef20e36 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:31.172724 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1bd59156-7355-4aa4-a204-eb503ef20e36 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:31.179315 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e9e39267-5208-4d29-bd76-c011867823c1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:31.186287 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e9e39267-5208-4d29-bd76-c011867823c1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:31.198342 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-e9e39267-5208-4d29-bd76-c011867823c1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1405 microversion: 2.20 time: 0.987245 Nov 16 00:29:31.219735 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 61/111] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:29:30 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1405 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:29:31.584604 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-1bd59156-7355-4aa4-a204-eb503ef20e36 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:31.631090 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-7e2d3160-3409-4841-99c5-5c8ec719776f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:31.638486 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-7e2d3160-3409-4841-99c5-5c8ec719776f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:31.658063 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-1bd59156-7355-4aa4-a204-eb503ef20e36 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1322 microversion: 2.1 time: 0.528864 Nov 16 00:29:31.678816 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7e2d3160-3409-4841-99c5-5c8ec719776f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:31.679076 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 51/112] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:31 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:31.679272 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7e2d3160-3409-4841-99c5-5c8ec719776f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:31.679272 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7e2d3160-3409-4841-99c5-5c8ec719776f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:31.679272 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7e2d3160-3409-4841-99c5-5c8ec719776f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:32.078578 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-7e2d3160-3409-4841-99c5-5c8ec719776f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:32.110249 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-7e2d3160-3409-4841-99c5-5c8ec719776f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1362 microversion: 2.1 time: 0.495608 Nov 16 00:29:32.111290 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 62/113] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:31 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1362 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:32.247108 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-c72a898c-2b8d-4c8c-ab6d-5cfefe511449 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:32.249603 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-c72a898c-2b8d-4c8c-ab6d-5cfefe511449 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:32.272031 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c72a898c-2b8d-4c8c-ab6d-5cfefe511449 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:32.274196 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c72a898c-2b8d-4c8c-ab6d-5cfefe511449 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:32.276223 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c72a898c-2b8d-4c8c-ab6d-5cfefe511449 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:32.280242 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c72a898c-2b8d-4c8c-ab6d-5cfefe511449 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:32.600318 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-c72a898c-2b8d-4c8c-ab6d-5cfefe511449 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:32.612009 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-c72a898c-2b8d-4c8c-ab6d-5cfefe511449 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:32.614938 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-c72a898c-2b8d-4c8c-ab6d-5cfefe511449 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:32.616558 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-c72a898c-2b8d-4c8c-ab6d-5cfefe511449 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1405 microversion: 2.20 time: 0.380420 Nov 16 00:29:32.618733 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 52/114] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:29:32 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1405 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:29:32.712488 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ac6ccc26-5049-431e-9892-e4fdb15ef5fe tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:32.714006 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ac6ccc26-5049-431e-9892-e4fdb15ef5fe tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:32.742948 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ac6ccc26-5049-431e-9892-e4fdb15ef5fe tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:32.743996 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ac6ccc26-5049-431e-9892-e4fdb15ef5fe tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:32.745535 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ac6ccc26-5049-431e-9892-e4fdb15ef5fe tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:32.747667 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ac6ccc26-5049-431e-9892-e4fdb15ef5fe tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:32.909652 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-708385d5-8a57-4894-8526-ff4c882d01af tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:32.910515 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-708385d5-8a57-4894-8526-ff4c882d01af tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:32.917982 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-708385d5-8a57-4894-8526-ff4c882d01af tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:32.918751 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-708385d5-8a57-4894-8526-ff4c882d01af tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:32.919890 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-708385d5-8a57-4894-8526-ff4c882d01af tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:32.920534 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-708385d5-8a57-4894-8526-ff4c882d01af tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:32.999581 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-708385d5-8a57-4894-8526-ff4c882d01af tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Going to try to terminate instance {{(pid=122544) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:29:33.068878 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-ac6ccc26-5049-431e-9892-e4fdb15ef5fe tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:33.080053 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ac6ccc26-5049-431e-9892-e4fdb15ef5fe tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1515 microversion: 2.1 time: 0.384776 Nov 16 00:29:33.080716 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 63/115] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:32 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1515 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:33.111431 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1620aa40-29f7-412e-a081-c0777837dbf0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:33.114334 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1620aa40-29f7-412e-a081-c0777837dbf0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:33.123718 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1620aa40-29f7-412e-a081-c0777837dbf0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:33.124524 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1620aa40-29f7-412e-a081-c0777837dbf0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:33.140583 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1620aa40-29f7-412e-a081-c0777837dbf0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:33.144629 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1620aa40-29f7-412e-a081-c0777837dbf0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:33.234952 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-708385d5-8a57-4894-8526-ff4c882d01af tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "DELETE /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 204 len: 0 microversion: 2.1 time: 0.328893 Nov 16 00:29:33.236187 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 53/116] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:29:32 2021] DELETE /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 16 00:29:33.246163 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a90b0d57-9463-438c-adf9-cf06b1788ab8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:33.263351 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a90b0d57-9463-438c-adf9-cf06b1788ab8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:33.282957 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a90b0d57-9463-438c-adf9-cf06b1788ab8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:33.283208 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.objects.instance [None req-1620aa40-29f7-412e-a081-c0777837dbf0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lazy-loading 'flavor' on Instance uuid e9fc982a-6c0b-4489-8e17-7be77c13ddaf {{(pid=122543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:29:33.284943 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a90b0d57-9463-438c-adf9-cf06b1788ab8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:33.287860 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a90b0d57-9463-438c-adf9-cf06b1788ab8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:33.290660 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a90b0d57-9463-438c-adf9-cf06b1788ab8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:33.698081 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-1620aa40-29f7-412e-a081-c0777837dbf0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "POST /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf/action" status: 200 len: 32 microversion: 2.1 time: 0.590012 Nov 16 00:29:33.726808 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 64/117] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:29:33 2021] POST /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf/action => generated 32 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:29:33.772785 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-844c5481-5f96-49ad-bf9a-52cad739f676 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:33.775985 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-844c5481-5f96-49ad-bf9a-52cad739f676 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:33.811488 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-844c5481-5f96-49ad-bf9a-52cad739f676 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:33.812733 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-844c5481-5f96-49ad-bf9a-52cad739f676 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:33.814771 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-844c5481-5f96-49ad-bf9a-52cad739f676 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:33.816460 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-844c5481-5f96-49ad-bf9a-52cad739f676 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:33.851511 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a90b0d57-9463-438c-adf9-cf06b1788ab8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:33.887491 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a90b0d57-9463-438c-adf9-cf06b1788ab8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1362 microversion: 2.1 time: 0.640743 Nov 16 00:29:33.889952 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 54/118] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:33 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1362 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:33.908095 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-80d98bab-d282-490d-876e-ba7199072985 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:33.909414 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-80d98bab-d282-490d-876e-ba7199072985 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:33.949104 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-80d98bab-d282-490d-876e-ba7199072985 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:33.949927 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-80d98bab-d282-490d-876e-ba7199072985 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:33.959924 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-80d98bab-d282-490d-876e-ba7199072985 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:33.960821 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-80d98bab-d282-490d-876e-ba7199072985 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:34.490334 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-80d98bab-d282-490d-876e-ba7199072985 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:34.513533 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-80d98bab-d282-490d-876e-ba7199072985 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:34.515772 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-80d98bab-d282-490d-876e-ba7199072985 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:34.517325 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-80d98bab-d282-490d-876e-ba7199072985 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1405 microversion: 2.20 time: 0.625645 Nov 16 00:29:34.518524 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 55/119] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:29:33 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1405 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:29:34.524561 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-db836ca2-7b7b-4d2a-92f7-9d571db0ae2d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:34.525526 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-db836ca2-7b7b-4d2a-92f7-9d571db0ae2d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:34.532353 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-db836ca2-7b7b-4d2a-92f7-9d571db0ae2d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:34.533152 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-db836ca2-7b7b-4d2a-92f7-9d571db0ae2d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:34.535309 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-db836ca2-7b7b-4d2a-92f7-9d571db0ae2d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:34.535989 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-db836ca2-7b7b-4d2a-92f7-9d571db0ae2d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:34.665347 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-844c5481-5f96-49ad-bf9a-52cad739f676 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:34.681127 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-844c5481-5f96-49ad-bf9a-52cad739f676 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1554 microversion: 2.1 time: 0.950727 Nov 16 00:29:34.681990 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 65/120] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:33 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1554 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:34.689077 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-481d3819-9a73-40d2-8fa0-68a16b11d750 req-b7cbbe1f-58e2-4a6c-9320-99543b4d5696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f9b823f-75c2-4baf-9577-5dc85ec77405", "name": "network-vif-plugged", "status": "completed", "tag": "10abc4a6-a723-4a5c-855b-11d4b6d40eb9"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:34.691536 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:29:34.691536 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:29:34.700203 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-481d3819-9a73-40d2-8fa0-68a16b11d750 req-b7cbbe1f-58e2-4a6c-9320-99543b4d5696 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:34.700644 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-481d3819-9a73-40d2-8fa0-68a16b11d750 req-b7cbbe1f-58e2-4a6c-9320-99543b4d5696 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:34.713281 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-481d3819-9a73-40d2-8fa0-68a16b11d750 req-b7cbbe1f-58e2-4a6c-9320-99543b4d5696 service nova] Creating event network-vif-plugged:10abc4a6-a723-4a5c-855b-11d4b6d40eb9 for instance 3f9b823f-75c2-4baf-9577-5dc85ec77405 on hv-cinder-81115 Nov 16 00:29:34.721338 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-481d3819-9a73-40d2-8fa0-68a16b11d750 req-b7cbbe1f-58e2-4a6c-9320-99543b4d5696 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037520 Nov 16 00:29:34.722517 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 66/121] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:29:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:29:34.777910 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-db836ca2-7b7b-4d2a-92f7-9d571db0ae2d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:34.795537 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-db836ca2-7b7b-4d2a-92f7-9d571db0ae2d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.274938 Nov 16 00:29:34.797113 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 56/122] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:34 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:34.923491 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-0a9abda7-f9de-4879-9fa4-e814d9fa1a9f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:34.927228 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-0a9abda7-f9de-4879-9fa4-e814d9fa1a9f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:34.953016 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0a9abda7-f9de-4879-9fa4-e814d9fa1a9f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:34.954094 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0a9abda7-f9de-4879-9fa4-e814d9fa1a9f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:34.955846 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0a9abda7-f9de-4879-9fa4-e814d9fa1a9f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:34.956571 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0a9abda7-f9de-4879-9fa4-e814d9fa1a9f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:35.279714 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-0a9abda7-f9de-4879-9fa4-e814d9fa1a9f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:35.290953 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-0a9abda7-f9de-4879-9fa4-e814d9fa1a9f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1362 microversion: 2.1 time: 0.375600 Nov 16 00:29:35.291922 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 67/123] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:34 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1362 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:35.552169 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-47ad6290-57ae-4a75-bbce-24f81b0af1c2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:35.553490 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-47ad6290-57ae-4a75-bbce-24f81b0af1c2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:35.569348 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-47ad6290-57ae-4a75-bbce-24f81b0af1c2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:35.570051 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-47ad6290-57ae-4a75-bbce-24f81b0af1c2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:35.571884 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-47ad6290-57ae-4a75-bbce-24f81b0af1c2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:35.572588 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-47ad6290-57ae-4a75-bbce-24f81b0af1c2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:35.703345 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-0203a38c-92ad-438b-9cf1-12896c0cc7e5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:35.707306 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-0203a38c-92ad-438b-9cf1-12896c0cc7e5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:35.718746 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0203a38c-92ad-438b-9cf1-12896c0cc7e5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:35.719516 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0203a38c-92ad-438b-9cf1-12896c0cc7e5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:35.720950 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0203a38c-92ad-438b-9cf1-12896c0cc7e5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:35.723334 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0203a38c-92ad-438b-9cf1-12896c0cc7e5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:35.885826 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-47ad6290-57ae-4a75-bbce-24f81b0af1c2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:35.900211 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-47ad6290-57ae-4a75-bbce-24f81b0af1c2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:35.916481 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-47ad6290-57ae-4a75-bbce-24f81b0af1c2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:35.917868 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-47ad6290-57ae-4a75-bbce-24f81b0af1c2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1405 microversion: 2.20 time: 0.374448 Nov 16 00:29:35.918496 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 57/124] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:29:35 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1405 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:29:35.943633 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-5a301419-7a45-4789-986b-05e5a8a98776 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:35.944673 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-5a301419-7a45-4789-986b-05e5a8a98776 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:35.965558 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5a301419-7a45-4789-986b-05e5a8a98776 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:35.967280 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5a301419-7a45-4789-986b-05e5a8a98776 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:35.970641 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5a301419-7a45-4789-986b-05e5a8a98776 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:35.973162 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5a301419-7a45-4789-986b-05e5a8a98776 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:36.226993 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-5a301419-7a45-4789-986b-05e5a8a98776 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:36.242818 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-5a301419-7a45-4789-986b-05e5a8a98776 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.317133 Nov 16 00:29:36.247115 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 58/125] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:35 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:36.289497 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-0203a38c-92ad-438b-9cf1-12896c0cc7e5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:36.302015 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-0203a38c-92ad-438b-9cf1-12896c0cc7e5 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1554 microversion: 2.1 time: 0.604596 Nov 16 00:29:36.303352 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 68/126] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:35 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1554 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:36.329095 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-999d2d5c-d2e5-42e8-a72a-b69160a5fbbf tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:36.330194 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-999d2d5c-d2e5-42e8-a72a-b69160a5fbbf tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:36.349270 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-999d2d5c-d2e5-42e8-a72a-b69160a5fbbf tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:36.350586 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-999d2d5c-d2e5-42e8-a72a-b69160a5fbbf tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:36.351767 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-999d2d5c-d2e5-42e8-a72a-b69160a5fbbf tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:36.352580 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-999d2d5c-d2e5-42e8-a72a-b69160a5fbbf tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:36.685043 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-999d2d5c-d2e5-42e8-a72a-b69160a5fbbf tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:36.698220 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-999d2d5c-d2e5-42e8-a72a-b69160a5fbbf tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1362 microversion: 2.1 time: 0.375972 Nov 16 00:29:36.700126 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 59/127] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:36 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1362 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:36.958890 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-fd4e5b23-bcd4-46ab-8702-4eb66bb81e7e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:36.960079 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-fd4e5b23-bcd4-46ab-8702-4eb66bb81e7e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:36.986543 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fd4e5b23-bcd4-46ab-8702-4eb66bb81e7e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:36.990320 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fd4e5b23-bcd4-46ab-8702-4eb66bb81e7e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:36.992236 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fd4e5b23-bcd4-46ab-8702-4eb66bb81e7e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:36.995209 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fd4e5b23-bcd4-46ab-8702-4eb66bb81e7e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:37.262330 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-22cb915a-78ed-4856-befe-b9ee10565afb tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:37.263170 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-22cb915a-78ed-4856-befe-b9ee10565afb tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:37.280420 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-22cb915a-78ed-4856-befe-b9ee10565afb tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:37.280903 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-22cb915a-78ed-4856-befe-b9ee10565afb tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:37.281874 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-22cb915a-78ed-4856-befe-b9ee10565afb tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:37.282368 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-22cb915a-78ed-4856-befe-b9ee10565afb tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:37.546984 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-fd4e5b23-bcd4-46ab-8702-4eb66bb81e7e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:37.560376 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-fd4e5b23-bcd4-46ab-8702-4eb66bb81e7e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:37.562770 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-fd4e5b23-bcd4-46ab-8702-4eb66bb81e7e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:37.566463 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-fd4e5b23-bcd4-46ab-8702-4eb66bb81e7e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1405 microversion: 2.20 time: 0.616846 Nov 16 00:29:37.567090 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 69/128] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:29:36 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1405 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:29:37.579173 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-835605af-067e-427b-b4ce-a9d498d24fd4 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:37.580050 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-835605af-067e-427b-b4ce-a9d498d24fd4 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:37.594838 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-835605af-067e-427b-b4ce-a9d498d24fd4 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:37.595756 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-835605af-067e-427b-b4ce-a9d498d24fd4 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:37.597789 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-835605af-067e-427b-b4ce-a9d498d24fd4 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:37.600571 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-835605af-067e-427b-b4ce-a9d498d24fd4 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:38.010480 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-22cb915a-78ed-4856-befe-b9ee10565afb tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:38.018479 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-22cb915a-78ed-4856-befe-b9ee10565afb tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.760804 Nov 16 00:29:38.022173 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 60/129] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:37 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:38.047773 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a61d3b9e-73a4-4b86-837b-85ee2cf36ad5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:38.052059 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a61d3b9e-73a4-4b86-837b-85ee2cf36ad5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:38.070672 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a61d3b9e-73a4-4b86-837b-85ee2cf36ad5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:38.073761 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a61d3b9e-73a4-4b86-837b-85ee2cf36ad5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:38.074611 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a61d3b9e-73a4-4b86-837b-85ee2cf36ad5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:38.079444 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a61d3b9e-73a4-4b86-837b-85ee2cf36ad5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:38.153981 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-835605af-067e-427b-b4ce-a9d498d24fd4 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:38.204909 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-835605af-067e-427b-b4ce-a9d498d24fd4 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1554 microversion: 2.1 time: 0.629092 Nov 16 00:29:38.206214 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 70/130] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:37 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1554 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:38.478047 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a61d3b9e-73a4-4b86-837b-85ee2cf36ad5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:38.489071 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a61d3b9e-73a4-4b86-837b-85ee2cf36ad5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1362 microversion: 2.1 time: 0.464652 Nov 16 00:29:38.491745 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 61/131] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:38 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1362 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:38.586508 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-3bd84407-72d5-4825-ba1b-5ff83fe93af9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:38.588850 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-3bd84407-72d5-4825-ba1b-5ff83fe93af9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:38.600210 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3bd84407-72d5-4825-ba1b-5ff83fe93af9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:38.601430 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3bd84407-72d5-4825-ba1b-5ff83fe93af9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:38.602940 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3bd84407-72d5-4825-ba1b-5ff83fe93af9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:38.604181 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3bd84407-72d5-4825-ba1b-5ff83fe93af9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:38.854472 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-3bd84407-72d5-4825-ba1b-5ff83fe93af9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:38.872380 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-3bd84407-72d5-4825-ba1b-5ff83fe93af9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:38.875310 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-3bd84407-72d5-4825-ba1b-5ff83fe93af9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:38.879740 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-3bd84407-72d5-4825-ba1b-5ff83fe93af9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1405 microversion: 2.20 time: 0.296484 Nov 16 00:29:38.881837 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 71/132] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:29:38 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1405 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:29:39.055506 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-18139f52-2eab-4d77-8b0b-a885bf3700a5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:39.066449 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-18139f52-2eab-4d77-8b0b-a885bf3700a5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:39.107247 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-18139f52-2eab-4d77-8b0b-a885bf3700a5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:39.110784 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-18139f52-2eab-4d77-8b0b-a885bf3700a5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:39.118948 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-18139f52-2eab-4d77-8b0b-a885bf3700a5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:39.121431 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-18139f52-2eab-4d77-8b0b-a885bf3700a5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:39.228902 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-7e9b6cfe-546f-4e65-9f26-092a1be88ee1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:39.237360 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-7e9b6cfe-546f-4e65-9f26-092a1be88ee1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:39.297648 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7e9b6cfe-546f-4e65-9f26-092a1be88ee1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:39.302791 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7e9b6cfe-546f-4e65-9f26-092a1be88ee1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:39.305528 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7e9b6cfe-546f-4e65-9f26-092a1be88ee1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:39.310075 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7e9b6cfe-546f-4e65-9f26-092a1be88ee1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:39.811894 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-7e9b6cfe-546f-4e65-9f26-092a1be88ee1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:39.860078 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-7e9b6cfe-546f-4e65-9f26-092a1be88ee1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1554 microversion: 2.1 time: 0.636552 Nov 16 00:29:39.863758 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 72/133] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:39 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1554 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:39.891644 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-9ccdd012-0c16-45de-af11-bda57db899ca tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:39.892831 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-9ccdd012-0c16-45de-af11-bda57db899ca tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:39.941165 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9ccdd012-0c16-45de-af11-bda57db899ca tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:39.941869 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9ccdd012-0c16-45de-af11-bda57db899ca tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:39.943358 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9ccdd012-0c16-45de-af11-bda57db899ca tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:39.944122 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9ccdd012-0c16-45de-af11-bda57db899ca tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:40.453542 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-9ccdd012-0c16-45de-af11-bda57db899ca tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:40.470243 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-9ccdd012-0c16-45de-af11-bda57db899ca tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1362 microversion: 2.1 time: 0.604603 Nov 16 00:29:40.488233 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 73/134] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:39 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1362 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:40.499733 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-55af0055-af8b-43a2-88fd-e843b77f38bc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:40.500982 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-55af0055-af8b-43a2-88fd-e843b77f38bc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:40.521364 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-55af0055-af8b-43a2-88fd-e843b77f38bc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:40.522568 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-55af0055-af8b-43a2-88fd-e843b77f38bc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:40.535099 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-55af0055-af8b-43a2-88fd-e843b77f38bc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:40.536130 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-55af0055-af8b-43a2-88fd-e843b77f38bc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:40.666408 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-18139f52-2eab-4d77-8b0b-a885bf3700a5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:40.702546 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-18139f52-2eab-4d77-8b0b-a885bf3700a5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 1.659019 Nov 16 00:29:40.707187 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 62/135] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:39 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:40.733174 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-7fd9cd01-ada9-4885-9a2a-6a357f971719 req-ed50d274-68bc-4ef7-85f5-88fcfe8a2a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea7d54f-7240-4037-b2c3-137104f78dac", "name": "network-vif-deleted", "tag": "039fa937-ef8e-4555-be41-74f1bdbe2313"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:40.737681 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:29:40.737681 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:29:40.766097 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-7fd9cd01-ada9-4885-9a2a-6a357f971719 req-ed50d274-68bc-4ef7-85f5-88fcfe8a2a9f service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:40.767350 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-7fd9cd01-ada9-4885-9a2a-6a357f971719 req-ed50d274-68bc-4ef7-85f5-88fcfe8a2a9f service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:40.801474 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-7fd9cd01-ada9-4885-9a2a-6a357f971719 req-ed50d274-68bc-4ef7-85f5-88fcfe8a2a9f service nova] Creating event network-vif-deleted:039fa937-ef8e-4555-be41-74f1bdbe2313 for instance bea7d54f-7240-4037-b2c3-137104f78dac on hv-cinder-81115 Nov 16 00:29:40.813182 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-7fd9cd01-ada9-4885-9a2a-6a357f971719 req-ed50d274-68bc-4ef7-85f5-88fcfe8a2a9f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090490 Nov 16 00:29:40.814834 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 63/136] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:29:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:29:40.892459 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-9d7fafb6-7925-4edc-a465-c7c42ded4344 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:40.899311 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-9d7fafb6-7925-4edc-a465-c7c42ded4344 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:40.913532 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9d7fafb6-7925-4edc-a465-c7c42ded4344 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:40.913978 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9d7fafb6-7925-4edc-a465-c7c42ded4344 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:40.917542 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9d7fafb6-7925-4edc-a465-c7c42ded4344 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:40.917760 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9d7fafb6-7925-4edc-a465-c7c42ded4344 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:40.997676 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-55af0055-af8b-43a2-88fd-e843b77f38bc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:41.010787 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-55af0055-af8b-43a2-88fd-e843b77f38bc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:41.012458 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-55af0055-af8b-43a2-88fd-e843b77f38bc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:41.013591 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-55af0055-af8b-43a2-88fd-e843b77f38bc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1597 microversion: 2.20 time: 0.523548 Nov 16 00:29:41.014148 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 74/137] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:29:40 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1597 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:29:41.047219 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-90f2569f-5db9-49e5-9dd8-d449e59d4d2f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:41.047778 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-90f2569f-5db9-49e5-9dd8-d449e59d4d2f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:41.063466 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-90f2569f-5db9-49e5-9dd8-d449e59d4d2f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:41.063922 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-90f2569f-5db9-49e5-9dd8-d449e59d4d2f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:41.065425 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-90f2569f-5db9-49e5-9dd8-d449e59d4d2f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:41.065701 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-90f2569f-5db9-49e5-9dd8-d449e59d4d2f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:41.212655 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-9d7fafb6-7925-4edc-a465-c7c42ded4344 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:41.233076 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-90f2569f-5db9-49e5-9dd8-d449e59d4d2f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.189608 Nov 16 00:29:41.234799 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 75/138] 10.222.0.31 () {60 vars in 1315 bytes} [Tue Nov 16 00:29:41 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/os-interface => generated 285 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:29:41.241782 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-9d7fafb6-7925-4edc-a465-c7c42ded4344 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1512 microversion: 2.1 time: 0.360215 Nov 16 00:29:41.260150 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 64/139] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:40 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1512 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:41.505936 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-5e3d4e58-4614-4e94-879a-00904cccddf9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:41.519225 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-5e3d4e58-4614-4e94-879a-00904cccddf9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:41.530455 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5e3d4e58-4614-4e94-879a-00904cccddf9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:41.538561 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5e3d4e58-4614-4e94-879a-00904cccddf9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:41.540474 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5e3d4e58-4614-4e94-879a-00904cccddf9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:41.541413 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5e3d4e58-4614-4e94-879a-00904cccddf9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:41.743839 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e651c99c-40c3-4ff5-8e18-c92e3ce1c230 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:41.744931 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e651c99c-40c3-4ff5-8e18-c92e3ce1c230 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:41.782100 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e651c99c-40c3-4ff5-8e18-c92e3ce1c230 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:41.782846 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e651c99c-40c3-4ff5-8e18-c92e3ce1c230 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:41.785231 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e651c99c-40c3-4ff5-8e18-c92e3ce1c230 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:41.792005 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e651c99c-40c3-4ff5-8e18-c92e3ce1c230 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:42.338639 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e651c99c-40c3-4ff5-8e18-c92e3ce1c230 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:42.357924 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e651c99c-40c3-4ff5-8e18-c92e3ce1c230 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.621264 Nov 16 00:29:42.382863 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 65/140] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:41 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:42.404205 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-56c50629-9fec-44f4-8a14-d44af0a57aeb tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:42.405013 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-56c50629-9fec-44f4-8a14-d44af0a57aeb tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:42.418722 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-56c50629-9fec-44f4-8a14-d44af0a57aeb tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:42.419444 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-56c50629-9fec-44f4-8a14-d44af0a57aeb tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:42.420436 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-56c50629-9fec-44f4-8a14-d44af0a57aeb tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:42.420963 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-56c50629-9fec-44f4-8a14-d44af0a57aeb tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:42.547405 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-5e3d4e58-4614-4e94-879a-00904cccddf9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:42.560552 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-5e3d4e58-4614-4e94-879a-00904cccddf9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1362 microversion: 2.1 time: 1.061705 Nov 16 00:29:42.561534 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-56c50629-9fec-44f4-8a14-d44af0a57aeb tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:42.561945 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 76/141] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:41 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1362 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:42.586670 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-56c50629-9fec-44f4-8a14-d44af0a57aeb tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1346 microversion: 2.1 time: 0.197637 Nov 16 00:29:42.587885 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 66/142] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:42 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1346 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:43.391454 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-b0b3aa53-22a4-4156-b321-d492f541c6fc tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:43.391969 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b0b3aa53-22a4-4156-b321-d492f541c6fc tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:43.410949 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b0b3aa53-22a4-4156-b321-d492f541c6fc tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:43.411427 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b0b3aa53-22a4-4156-b321-d492f541c6fc tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:43.415933 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b0b3aa53-22a4-4156-b321-d492f541c6fc tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:43.416632 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b0b3aa53-22a4-4156-b321-d492f541c6fc tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:43.592012 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-ac9734a0-7f2e-4599-9e84-c0819ca68084 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:43.592808 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-ac9734a0-7f2e-4599-9e84-c0819ca68084 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:43.606921 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ac9734a0-7f2e-4599-9e84-c0819ca68084 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:43.607806 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ac9734a0-7f2e-4599-9e84-c0819ca68084 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:43.608994 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ac9734a0-7f2e-4599-9e84-c0819ca68084 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:43.614033 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ac9734a0-7f2e-4599-9e84-c0819ca68084 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:44.023811 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-ac9734a0-7f2e-4599-9e84-c0819ca68084 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:44.042399 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-ac9734a0-7f2e-4599-9e84-c0819ca68084 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1362 microversion: 2.1 time: 0.454076 Nov 16 00:29:44.043938 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 67/143] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:43 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1362 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:44.071878 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a00b85af-d310-4330-adc3-b7ffe37af4a9 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:44.072900 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a00b85af-d310-4330-adc3-b7ffe37af4a9 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:44.090328 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a00b85af-d310-4330-adc3-b7ffe37af4a9 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:44.092749 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a00b85af-d310-4330-adc3-b7ffe37af4a9 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:44.097792 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a00b85af-d310-4330-adc3-b7ffe37af4a9 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:44.101941 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a00b85af-d310-4330-adc3-b7ffe37af4a9 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:44.185989 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a00b85af-d310-4330-adc3-b7ffe37af4a9 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:44.186737 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a00b85af-d310-4330-adc3-b7ffe37af4a9 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:44.187576 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.objects.instance [None req-a00b85af-d310-4330-adc3-b7ffe37af4a9 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lazy-loading 'fault' on Instance uuid bea7d54f-7240-4037-b2c3-137104f78dac {{(pid=122544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:29:44.257221 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a00b85af-d310-4330-adc3-b7ffe37af4a9 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '464dae8aa1f24b939735e0735fba0904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273835248c36490c9fc2db9b2a651333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:44.272577 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a00b85af-d310-4330-adc3-b7ffe37af4a9 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 200 len: 1351 microversion: 2.1 time: 0.217099 Nov 16 00:29:44.276773 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 68/144] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:44 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 1351 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:44.297392 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-a3bad167-60c4-45f4-a05f-8ff64ec5728e req-8502cb8b-4d2f-436d-80cb-e152fc2994b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f376e4-af26-4799-9127-58d9efd50cdc", "name": "network-vif-plugged", "status": "completed", "tag": "01184432-b920-416d-948c-2998a3138394"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:44.313777 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-b0b3aa53-22a4-4156-b321-d492f541c6fc tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:44.324810 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:29:44.324810 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:29:44.328363 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-b0b3aa53-22a4-4156-b321-d492f541c6fc tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.941227 Nov 16 00:29:44.328952 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 77/145] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:43 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:44.353004 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-a3bad167-60c4-45f4-a05f-8ff64ec5728e req-8502cb8b-4d2f-436d-80cb-e152fc2994b5 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:44.353454 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-a3bad167-60c4-45f4-a05f-8ff64ec5728e req-8502cb8b-4d2f-436d-80cb-e152fc2994b5 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:44.395536 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-a3bad167-60c4-45f4-a05f-8ff64ec5728e req-8502cb8b-4d2f-436d-80cb-e152fc2994b5 service nova] Creating event network-vif-plugged:01184432-b920-416d-948c-2998a3138394 for instance d6f376e4-af26-4799-9127-58d9efd50cdc on hv-cinder-81115 Nov 16 00:29:44.407877 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-a3bad167-60c4-45f4-a05f-8ff64ec5728e req-8502cb8b-4d2f-436d-80cb-e152fc2994b5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129584 Nov 16 00:29:44.409617 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 69/146] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:29:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:29:44.686991 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1235e2fc-63dd-4e17-b1d5-372c77d762dd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:44.688852 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1235e2fc-63dd-4e17-b1d5-372c77d762dd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:44.713779 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1235e2fc-63dd-4e17-b1d5-372c77d762dd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:44.715236 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-12a007df-88e8-4184-b876-1fa7a8dc112b req-463cffd4-a7e4-4883-bf01-7f4f50eda764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f9b823f-75c2-4baf-9577-5dc85ec77405", "tag": "10abc4a6-a723-4a5c-855b-11d4b6d40eb9"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:44.718473 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1235e2fc-63dd-4e17-b1d5-372c77d762dd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:44.721663 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:29:44.721663 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:29:44.723521 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1235e2fc-63dd-4e17-b1d5-372c77d762dd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:44.732309 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1235e2fc-63dd-4e17-b1d5-372c77d762dd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:44.754674 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-12a007df-88e8-4184-b876-1fa7a8dc112b req-463cffd4-a7e4-4883-bf01-7f4f50eda764 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:44.772324 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-12a007df-88e8-4184-b876-1fa7a8dc112b req-463cffd4-a7e4-4883-bf01-7f4f50eda764 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:44.826316 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-12a007df-88e8-4184-b876-1fa7a8dc112b req-463cffd4-a7e4-4883-bf01-7f4f50eda764 service nova] Creating event network-changed:10abc4a6-a723-4a5c-855b-11d4b6d40eb9 for instance 3f9b823f-75c2-4baf-9577-5dc85ec77405 on hv-cinder-81115 Nov 16 00:29:44.852792 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-12a007df-88e8-4184-b876-1fa7a8dc112b req-463cffd4-a7e4-4883-bf01-7f4f50eda764 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153568 Nov 16 00:29:44.855776 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 70/147] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:29:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:29:44.928761 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-1235e2fc-63dd-4e17-b1d5-372c77d762dd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 14 microversion: 2.20 time: 0.250139 Nov 16 00:29:44.929595 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 78/148] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:29:44 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 14 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:45.079541 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-6c30c5a1-35e5-45e4-b03a-4d73992c30a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:45.080260 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-6c30c5a1-35e5-45e4-b03a-4d73992c30a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:45.099713 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6c30c5a1-35e5-45e4-b03a-4d73992c30a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:45.107453 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6c30c5a1-35e5-45e4-b03a-4d73992c30a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:45.109039 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6c30c5a1-35e5-45e4-b03a-4d73992c30a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:45.109735 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6c30c5a1-35e5-45e4-b03a-4d73992c30a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:45.296494 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-dd93812f-4290-4d59-a3ac-bba99b71fa15 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:45.297638 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-dd93812f-4290-4d59-a3ac-bba99b71fa15 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:45.317640 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-dd93812f-4290-4d59-a3ac-bba99b71fa15 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:45.328727 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-dd93812f-4290-4d59-a3ac-bba99b71fa15 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:45.330032 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-dd93812f-4290-4d59-a3ac-bba99b71fa15 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:45.336412 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-dd93812f-4290-4d59-a3ac-bba99b71fa15 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:45.396833 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-dd93812f-4290-4d59-a3ac-bba99b71fa15 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] HTTP exception thrown: Instance bea7d54f-7240-4037-b2c3-137104f78dac could not be found. Nov 16 00:29:45.401004 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-dd93812f-4290-4d59-a3ac-bba99b71fa15 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Returning 404 to user: Instance bea7d54f-7240-4037-b2c3-137104f78dac could not be found. {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:29:45.406603 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-dd93812f-4290-4d59-a3ac-bba99b71fa15 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 404 len: 111 microversion: 2.1 time: 0.115174 Nov 16 00:29:45.407683 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 79/149] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:45 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:29:45.429174 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-cca7e540-9501-42a1-b76b-552a6446d177 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:45.430366 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-cca7e540-9501-42a1-b76b-552a6446d177 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:45.450406 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cca7e540-9501-42a1-b76b-552a6446d177 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:45.455116 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cca7e540-9501-42a1-b76b-552a6446d177 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:45.459781 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cca7e540-9501-42a1-b76b-552a6446d177 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:45.460389 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cca7e540-9501-42a1-b76b-552a6446d177 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:46.258251 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-cca7e540-9501-42a1-b76b-552a6446d177 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:46.279779 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-cca7e540-9501-42a1-b76b-552a6446d177 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.866488 Nov 16 00:29:46.292042 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 80/150] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:45 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:46.300363 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ac03ac65-83cf-4186-a5f1-ed93e15129f1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:46.301713 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ac03ac65-83cf-4186-a5f1-ed93e15129f1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:46.309753 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ac03ac65-83cf-4186-a5f1-ed93e15129f1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:46.311324 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ac03ac65-83cf-4186-a5f1-ed93e15129f1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:46.312657 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ac03ac65-83cf-4186-a5f1-ed93e15129f1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:46.313341 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ac03ac65-83cf-4186-a5f1-ed93e15129f1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:46.333480 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-ac03ac65-83cf-4186-a5f1-ed93e15129f1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] HTTP exception thrown: Instance bea7d54f-7240-4037-b2c3-137104f78dac could not be found. Nov 16 00:29:46.336625 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ac03ac65-83cf-4186-a5f1-ed93e15129f1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Returning 404 to user: Instance bea7d54f-7240-4037-b2c3-137104f78dac could not be found. {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:29:46.338182 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ac03ac65-83cf-4186-a5f1-ed93e15129f1 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043887 Nov 16 00:29:46.339612 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 81/151] 10.222.0.31 () {58 vars in 1301 bytes} [Tue Nov 16 00:29:46 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:29:46.368225 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-222a95c5-5508-4ccb-af3e-c346a1afe6a3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:46.372145 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-222a95c5-5508-4ccb-af3e-c346a1afe6a3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:46.390915 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-222a95c5-5508-4ccb-af3e-c346a1afe6a3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:46.392597 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-222a95c5-5508-4ccb-af3e-c346a1afe6a3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:46.399378 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-222a95c5-5508-4ccb-af3e-c346a1afe6a3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:46.400074 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-222a95c5-5508-4ccb-af3e-c346a1afe6a3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:46.431588 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-6c30c5a1-35e5-45e4-b03a-4d73992c30a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:46.456968 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-6c30c5a1-35e5-45e4-b03a-4d73992c30a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1362 microversion: 2.1 time: 1.382201 Nov 16 00:29:46.473609 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 71/152] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:45 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1362 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:46.494651 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-222a95c5-5508-4ccb-af3e-c346a1afe6a3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 14 microversion: 2.20 time: 0.153054 Nov 16 00:29:46.496227 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 82/153] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:29:46 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:47.300000 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-69df0b28-137b-4f40-873f-9cb046b757d7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:47.300865 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-69df0b28-137b-4f40-873f-9cb046b757d7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:47.311505 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-69df0b28-137b-4f40-873f-9cb046b757d7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:47.311953 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-69df0b28-137b-4f40-873f-9cb046b757d7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:47.312744 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-69df0b28-137b-4f40-873f-9cb046b757d7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:47.313178 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-69df0b28-137b-4f40-873f-9cb046b757d7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:47.482553 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-6a0bb048-3358-4f6b-9b74-cbbc3cb4afab tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:47.484093 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-6a0bb048-3358-4f6b-9b74-cbbc3cb4afab tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:47.506071 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6a0bb048-3358-4f6b-9b74-cbbc3cb4afab tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:47.510256 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6a0bb048-3358-4f6b-9b74-cbbc3cb4afab tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:47.511773 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6a0bb048-3358-4f6b-9b74-cbbc3cb4afab tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:47.512394 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6a0bb048-3358-4f6b-9b74-cbbc3cb4afab tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:47.893845 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-6a0bb048-3358-4f6b-9b74-cbbc3cb4afab tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:47.904695 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-6a0bb048-3358-4f6b-9b74-cbbc3cb4afab tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1548 microversion: 2.1 time: 0.426307 Nov 16 00:29:47.911890 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 83/154] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:47 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1548 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:47.918569 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-b05cae57-fdd9-401d-b559-e052f1e36019 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:47.919410 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b05cae57-fdd9-401d-b559-e052f1e36019 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:47.932232 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b05cae57-fdd9-401d-b559-e052f1e36019 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:47.932675 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b05cae57-fdd9-401d-b559-e052f1e36019 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:47.933463 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b05cae57-fdd9-401d-b559-e052f1e36019 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:47.938289 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-69df0b28-137b-4f40-873f-9cb046b757d7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:47.954316 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-69df0b28-137b-4f40-873f-9cb046b757d7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.658997 Nov 16 00:29:47.955808 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b05cae57-fdd9-401d-b559-e052f1e36019 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:47.956628 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 72/155] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:47 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:47.985126 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-720a4199-ecc7-4fd9-9518-02a027e30517 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:47.985855 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-720a4199-ecc7-4fd9-9518-02a027e30517 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:48.007406 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-720a4199-ecc7-4fd9-9518-02a027e30517 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:48.011144 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-720a4199-ecc7-4fd9-9518-02a027e30517 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:48.014001 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-720a4199-ecc7-4fd9-9518-02a027e30517 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:48.014576 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-720a4199-ecc7-4fd9-9518-02a027e30517 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:48.106163 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-b05cae57-fdd9-401d-b559-e052f1e36019 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 14 microversion: 2.20 time: 0.192884 Nov 16 00:29:48.109635 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 84/156] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:29:47 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:48.117862 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-41771a33-fca4-4c43-b4dd-2d7d9d218b8c tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:48.120712 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-41771a33-fca4-4c43-b4dd-2d7d9d218b8c tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:48.140245 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-41771a33-fca4-4c43-b4dd-2d7d9d218b8c tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:48.141672 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-41771a33-fca4-4c43-b4dd-2d7d9d218b8c tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:48.144091 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-41771a33-fca4-4c43-b4dd-2d7d9d218b8c tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:48.148916 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-41771a33-fca4-4c43-b4dd-2d7d9d218b8c tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:48.172892 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-41771a33-fca4-4c43-b4dd-2d7d9d218b8c tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] HTTP exception thrown: Instance bea7d54f-7240-4037-b2c3-137104f78dac could not be found. Nov 16 00:29:48.173817 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-41771a33-fca4-4c43-b4dd-2d7d9d218b8c tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Returning 404 to user: Instance bea7d54f-7240-4037-b2c3-137104f78dac could not be found. {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:29:48.176187 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-41771a33-fca4-4c43-b4dd-2d7d9d218b8c tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "DELETE /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 404 len: 111 microversion: 2.1 time: 0.067899 Nov 16 00:29:48.177272 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 85/157] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:29:48 2021] DELETE /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:29:48.192662 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-9fe39981-69fa-4f0c-ac28-547842f038e7 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:48.194082 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-9fe39981-69fa-4f0c-ac28-547842f038e7 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] [instance: bea7d54f-7240-4037-b2c3-137104f78dac] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:48.220933 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9fe39981-69fa-4f0c-ac28-547842f038e7 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:48.225695 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9fe39981-69fa-4f0c-ac28-547842f038e7 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:48.229246 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9fe39981-69fa-4f0c-ac28-547842f038e7 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:48.233871 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9fe39981-69fa-4f0c-ac28-547842f038e7 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:48.250029 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-720a4199-ecc7-4fd9-9518-02a027e30517 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.290003 Nov 16 00:29:48.250949 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 73/158] 10.222.0.31 () {58 vars in 1274 bytes} [Tue Nov 16 00:29:47 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/os-interface => generated 285 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:29:48.284253 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-9fe39981-69fa-4f0c-ac28-547842f038e7 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] HTTP exception thrown: Instance bea7d54f-7240-4037-b2c3-137104f78dac could not be found. Nov 16 00:29:48.285022 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-9fe39981-69fa-4f0c-ac28-547842f038e7 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] Returning 404 to user: Instance bea7d54f-7240-4037-b2c3-137104f78dac could not be found. {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:29:48.286069 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-9fe39981-69fa-4f0c-ac28-547842f038e7 tempest-DeleteServersTestJSON-1617066579 tempest-DeleteServersTestJSON-1617066579-project] 10.222.0.31 "GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac" status: 404 len: 111 microversion: 2.1 time: 0.102217 Nov 16 00:29:48.286977 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 86/159] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:48 2021] GET /compute/v2.1/servers/bea7d54f-7240-4037-b2c3-137104f78dac => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:29:48.976958 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ce2cd3d9-3cfe-4dba-ba4f-176dac7676e3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:48.978045 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ce2cd3d9-3cfe-4dba-ba4f-176dac7676e3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:49.014011 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ce2cd3d9-3cfe-4dba-ba4f-176dac7676e3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:49.031358 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ce2cd3d9-3cfe-4dba-ba4f-176dac7676e3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:49.033299 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ce2cd3d9-3cfe-4dba-ba4f-176dac7676e3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:49.040477 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ce2cd3d9-3cfe-4dba-ba4f-176dac7676e3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:49.212986 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-4629cbc2-69a6-4069-babd-207c907caaf7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Action: 'create', calling method: .version_select at 0x7f2f297de5e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2139507500"}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:49.275673 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-4629cbc2-69a6-4069-babd-207c907caaf7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Getting quotas for project cce0078a151f47738c5863929c403dc7. Resources: {'key_pairs'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:29:49.296172 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-4629cbc2-69a6-4069-babd-207c907caaf7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Getting quotas for user 5fa70de1eca24c8da180736ff9ebc553 and project cce0078a151f47738c5863929c403dc7. Resources: {'key_pairs'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:29:49.633152 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-ce2cd3d9-3cfe-4dba-ba4f-176dac7676e3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:49.648329 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ce2cd3d9-3cfe-4dba-ba4f-176dac7676e3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.678049 Nov 16 00:29:49.648982 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 87/160] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:48 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:49.655024 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-40a3e7b1-6346-4be1-bb6e-98b85181e513 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:49.660251 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-40a3e7b1-6346-4be1-bb6e-98b85181e513 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:49.685256 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-40a3e7b1-6346-4be1-bb6e-98b85181e513 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:49.686031 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-40a3e7b1-6346-4be1-bb6e-98b85181e513 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:49.688520 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-40a3e7b1-6346-4be1-bb6e-98b85181e513 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:49.694453 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-40a3e7b1-6346-4be1-bb6e-98b85181e513 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:49.813375 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-40a3e7b1-6346-4be1-bb6e-98b85181e513 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 14 microversion: 2.20 time: 0.162950 Nov 16 00:29:49.814214 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 88/161] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:29:49 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:49.834448 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-4629cbc2-69a6-4069-babd-207c907caaf7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Getting quotas for project cce0078a151f47738c5863929c403dc7. Resources: {'key_pairs'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:29:49.844193 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-4629cbc2-69a6-4069-babd-207c907caaf7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Getting quotas for user 5fa70de1eca24c8da180736ff9ebc553 and project cce0078a151f47738c5863929c403dc7. Resources: {'key_pairs'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:29:49.917775 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-4629cbc2-69a6-4069-babd-207c907caaf7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.523293 Nov 16 00:29:49.923658 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 74/162] 10.222.0.31 () {60 vars in 1157 bytes} [Tue Nov 16 00:29:48 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:50.738360 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-738b7b97-d5ef-484d-9ecf-59010c227813 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:50.739863 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-738b7b97-d5ef-484d-9ecf-59010c227813 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:50.766347 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-738b7b97-d5ef-484d-9ecf-59010c227813 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:50.767471 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-738b7b97-d5ef-484d-9ecf-59010c227813 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:50.768595 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-738b7b97-d5ef-484d-9ecf-59010c227813 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:50.769276 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-738b7b97-d5ef-484d-9ecf-59010c227813 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:50.827163 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-cf72545a-e95c-4407-9d51-6e3689c82ed5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:50.828115 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-cf72545a-e95c-4407-9d51-6e3689c82ed5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:50.854704 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cf72545a-e95c-4407-9d51-6e3689c82ed5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:50.856933 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cf72545a-e95c-4407-9d51-6e3689c82ed5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:50.857969 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cf72545a-e95c-4407-9d51-6e3689c82ed5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:50.859714 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cf72545a-e95c-4407-9d51-6e3689c82ed5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:50.980054 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-cf72545a-e95c-4407-9d51-6e3689c82ed5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 14 microversion: 2.20 time: 0.157094 Nov 16 00:29:50.981395 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 75/163] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:29:50 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:50.988415 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3ef61f7e-fa10-4635-9f7b-c0471057959c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:50.992404 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3ef61f7e-fa10-4635-9f7b-c0471057959c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:51.006171 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3ef61f7e-fa10-4635-9f7b-c0471057959c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:51.006926 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3ef61f7e-fa10-4635-9f7b-c0471057959c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:51.007925 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3ef61f7e-fa10-4635-9f7b-c0471057959c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:51.008517 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3ef61f7e-fa10-4635-9f7b-c0471057959c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:51.116575 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-3ef61f7e-fa10-4635-9f7b-c0471057959c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 14 microversion: 2.1 time: 0.132869 Nov 16 00:29:51.117251 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 76/164] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:29:50 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:29:51.124503 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-7bddf337-bfd5-40cb-84a7-f7abb29b4141 req-1e90053a-23a1-4f51-a8f8-ae68185cf300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f376e4-af26-4799-9127-58d9efd50cdc", "tag": "01184432-b920-416d-948c-2998a3138394"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:51.126136 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:29:51.126136 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:29:51.152504 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-7bddf337-bfd5-40cb-84a7-f7abb29b4141 req-1e90053a-23a1-4f51-a8f8-ae68185cf300 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:51.155925 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-7bddf337-bfd5-40cb-84a7-f7abb29b4141 req-1e90053a-23a1-4f51-a8f8-ae68185cf300 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:51.188868 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-7bddf337-bfd5-40cb-84a7-f7abb29b4141 req-1e90053a-23a1-4f51-a8f8-ae68185cf300 service nova] Creating event network-changed:01184432-b920-416d-948c-2998a3138394 for instance d6f376e4-af26-4799-9127-58d9efd50cdc on hv-cinder-81115 Nov 16 00:29:51.217962 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-7bddf337-bfd5-40cb-84a7-f7abb29b4141 req-1e90053a-23a1-4f51-a8f8-ae68185cf300 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098971 Nov 16 00:29:51.218471 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 77/165] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:29:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:29:51.787511 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-738b7b97-d5ef-484d-9ecf-59010c227813 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:51.795490 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-738b7b97-d5ef-484d-9ecf-59010c227813 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 1.061962 Nov 16 00:29:51.807520 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 89/166] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:50 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:52.002962 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-42ece2ea-f4f9-4676-a66c-f28c77ede1f2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:52.008546 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-42ece2ea-f4f9-4676-a66c-f28c77ede1f2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:52.035949 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-42ece2ea-f4f9-4676-a66c-f28c77ede1f2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:52.036790 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-42ece2ea-f4f9-4676-a66c-f28c77ede1f2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:52.040674 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-42ece2ea-f4f9-4676-a66c-f28c77ede1f2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:52.041564 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-42ece2ea-f4f9-4676-a66c-f28c77ede1f2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:52.128156 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-616cb281-ccdc-4ea4-9f58-1d097401527f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:52.129138 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-616cb281-ccdc-4ea4-9f58-1d097401527f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:52.139715 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-616cb281-ccdc-4ea4-9f58-1d097401527f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:52.142362 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-42ece2ea-f4f9-4676-a66c-f28c77ede1f2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 14 microversion: 2.20 time: 0.153096 Nov 16 00:29:52.143406 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 78/167] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:29:51 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:52.143635 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-616cb281-ccdc-4ea4-9f58-1d097401527f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:52.148096 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-616cb281-ccdc-4ea4-9f58-1d097401527f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:52.148529 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-616cb281-ccdc-4ea4-9f58-1d097401527f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:52.258524 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-616cb281-ccdc-4ea4-9f58-1d097401527f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 14 microversion: 2.1 time: 0.133786 Nov 16 00:29:52.260437 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 90/168] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:29:52 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 16 00:29:52.820432 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-34d2fc2f-f039-4a12-b6d8-1c49bab193c2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:52.821537 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-34d2fc2f-f039-4a12-b6d8-1c49bab193c2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:52.869524 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-34d2fc2f-f039-4a12-b6d8-1c49bab193c2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:52.871981 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-34d2fc2f-f039-4a12-b6d8-1c49bab193c2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:52.882393 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-34d2fc2f-f039-4a12-b6d8-1c49bab193c2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:52.890170 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-34d2fc2f-f039-4a12-b6d8-1c49bab193c2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:53.159911 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-4281b24d-4c15-4d0e-a5db-77d76160088e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:53.160947 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-4281b24d-4c15-4d0e-a5db-77d76160088e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:53.184048 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4281b24d-4c15-4d0e-a5db-77d76160088e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:53.184498 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4281b24d-4c15-4d0e-a5db-77d76160088e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:53.185302 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4281b24d-4c15-4d0e-a5db-77d76160088e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:53.185730 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4281b24d-4c15-4d0e-a5db-77d76160088e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:53.324739 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-4281b24d-4c15-4d0e-a5db-77d76160088e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 14 microversion: 2.20 time: 0.172133 Nov 16 00:29:53.325777 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 91/169] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:29:53 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:53.332080 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-16ccdf6e-1e6d-4e7e-9afd-c967a473c4d7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:53.333119 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-16ccdf6e-1e6d-4e7e-9afd-c967a473c4d7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:53.347321 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-16ccdf6e-1e6d-4e7e-9afd-c967a473c4d7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:53.347895 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-16ccdf6e-1e6d-4e7e-9afd-c967a473c4d7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:53.348697 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-16ccdf6e-1e6d-4e7e-9afd-c967a473c4d7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:53.349131 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-16ccdf6e-1e6d-4e7e-9afd-c967a473c4d7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:53.457752 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-16ccdf6e-1e6d-4e7e-9afd-c967a473c4d7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 14 microversion: 2.1 time: 0.130358 Nov 16 00:29:53.458985 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 92/170] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:29:53 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:29:53.488230 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-34d2fc2f-f039-4a12-b6d8-1c49bab193c2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:53.501256 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-34d2fc2f-f039-4a12-b6d8-1c49bab193c2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.686567 Nov 16 00:29:53.512228 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 79/171] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:52 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:54.340720 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-dc91d1f0-19f2-47a2-bef4-8add25da7566 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:54.342724 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-dc91d1f0-19f2-47a2-bef4-8add25da7566 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:54.351658 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-dc91d1f0-19f2-47a2-bef4-8add25da7566 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:54.352435 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-dc91d1f0-19f2-47a2-bef4-8add25da7566 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:54.353640 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-dc91d1f0-19f2-47a2-bef4-8add25da7566 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:54.354525 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-dc91d1f0-19f2-47a2-bef4-8add25da7566 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:54.459875 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-dc91d1f0-19f2-47a2-bef4-8add25da7566 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 1652 microversion: 2.20 time: 0.125718 Nov 16 00:29:54.463334 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 93/172] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:29:54 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 1652 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:29:54.471661 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-2cc05a90-1386-4740-8393-ea7cf7fdbedc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:54.473007 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-2cc05a90-1386-4740-8393-ea7cf7fdbedc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:54.495691 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2cc05a90-1386-4740-8393-ea7cf7fdbedc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:54.502625 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2cc05a90-1386-4740-8393-ea7cf7fdbedc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:54.503508 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2cc05a90-1386-4740-8393-ea7cf7fdbedc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:54.507116 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2cc05a90-1386-4740-8393-ea7cf7fdbedc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:54.521449 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-27a93d30-77ae-414a-917d-f8575ee039ac tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:54.522235 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-27a93d30-77ae-414a-917d-f8575ee039ac tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:54.556798 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-27a93d30-77ae-414a-917d-f8575ee039ac tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:54.560597 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-27a93d30-77ae-414a-917d-f8575ee039ac tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:54.562753 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-27a93d30-77ae-414a-917d-f8575ee039ac tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:54.565965 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-27a93d30-77ae-414a-917d-f8575ee039ac tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:54.739381 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-2cc05a90-1386-4740-8393-ea7cf7fdbedc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 14 microversion: 2.1 time: 0.272997 Nov 16 00:29:54.745163 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 80/173] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:29:54 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 14 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 16 00:29:54.991420 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-27a93d30-77ae-414a-917d-f8575ee039ac tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:54.999927 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-27a93d30-77ae-414a-917d-f8575ee039ac tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.483168 Nov 16 00:29:55.009654 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 94/174] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:54 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:55.475284 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-7052ec12-e7fe-47f8-8bf4-6dfe267fdfb1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:55.476427 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-7052ec12-e7fe-47f8-8bf4-6dfe267fdfb1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:55.489313 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7052ec12-e7fe-47f8-8bf4-6dfe267fdfb1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:55.489781 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7052ec12-e7fe-47f8-8bf4-6dfe267fdfb1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:55.490604 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7052ec12-e7fe-47f8-8bf4-6dfe267fdfb1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:55.491068 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7052ec12-e7fe-47f8-8bf4-6dfe267fdfb1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:55.616332 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-7052ec12-e7fe-47f8-8bf4-6dfe267fdfb1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 9478 microversion: 2.20 time: 0.147462 Nov 16 00:29:55.618585 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 81/175] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:29:55 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 9478 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:29:55.754625 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-13944b61-e484-46b0-9751-3b7dc7126fff tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:55.755731 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-13944b61-e484-46b0-9751-3b7dc7126fff tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:55.769022 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-13944b61-e484-46b0-9751-3b7dc7126fff tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:55.784168 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-13944b61-e484-46b0-9751-3b7dc7126fff tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:55.785300 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-13944b61-e484-46b0-9751-3b7dc7126fff tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:55.785855 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-13944b61-e484-46b0-9751-3b7dc7126fff tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:55.874447 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-13944b61-e484-46b0-9751-3b7dc7126fff tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 14 microversion: 2.1 time: 0.124493 Nov 16 00:29:55.879888 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 95/176] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:29:55 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:29:56.018695 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-59e820f8-adbe-42d1-b5cf-8ad779fb4553 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:56.019731 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-59e820f8-adbe-42d1-b5cf-8ad779fb4553 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:56.035477 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-59e820f8-adbe-42d1-b5cf-8ad779fb4553 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:56.036342 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-59e820f8-adbe-42d1-b5cf-8ad779fb4553 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:56.038567 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-59e820f8-adbe-42d1-b5cf-8ad779fb4553 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:56.040775 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-59e820f8-adbe-42d1-b5cf-8ad779fb4553 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:56.327667 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-59e820f8-adbe-42d1-b5cf-8ad779fb4553 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:56.344435 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-59e820f8-adbe-42d1-b5cf-8ad779fb4553 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.331258 Nov 16 00:29:56.346312 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 82/177] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:56 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:29:56.631007 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-9f11eabd-9d6f-44f5-997e-4f0e2109ef72 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:56.632569 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-9f11eabd-9d6f-44f5-997e-4f0e2109ef72 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:56.640359 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9f11eabd-9d6f-44f5-997e-4f0e2109ef72 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:56.640803 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9f11eabd-9d6f-44f5-997e-4f0e2109ef72 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:56.641819 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9f11eabd-9d6f-44f5-997e-4f0e2109ef72 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:56.643115 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9f11eabd-9d6f-44f5-997e-4f0e2109ef72 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:56.756711 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-9f11eabd-9d6f-44f5-997e-4f0e2109ef72 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 14816 microversion: 2.20 time: 0.130056 Nov 16 00:29:56.766419 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 96/178] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:29:56 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 14816 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:29:56.890642 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-73e8e832-f5da-415d-82a7-65ba8839c6fd tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:56.893452 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-73e8e832-f5da-415d-82a7-65ba8839c6fd tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:56.902306 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-73e8e832-f5da-415d-82a7-65ba8839c6fd tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:56.903131 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-73e8e832-f5da-415d-82a7-65ba8839c6fd tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:56.904362 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-73e8e832-f5da-415d-82a7-65ba8839c6fd tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:56.905011 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-73e8e832-f5da-415d-82a7-65ba8839c6fd tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:57.004569 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-73e8e832-f5da-415d-82a7-65ba8839c6fd tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 14 microversion: 2.1 time: 0.119635 Nov 16 00:29:57.006153 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 83/179] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:29:56 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:29:57.365205 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-51c2aa2b-5ce5-4dea-8532-6d6e7613b169 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:57.365882 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-51c2aa2b-5ce5-4dea-8532-6d6e7613b169 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:57.375434 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-51c2aa2b-5ce5-4dea-8532-6d6e7613b169 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:57.376256 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-51c2aa2b-5ce5-4dea-8532-6d6e7613b169 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:57.377766 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-51c2aa2b-5ce5-4dea-8532-6d6e7613b169 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:57.378654 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-51c2aa2b-5ce5-4dea-8532-6d6e7613b169 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:57.567851 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-51c2aa2b-5ce5-4dea-8532-6d6e7613b169 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:57.577444 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-51c2aa2b-5ce5-4dea-8532-6d6e7613b169 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.217048 Nov 16 00:29:57.581302 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 97/180] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:57 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:57.786428 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e6f724b5-b2d9-479b-a86e-2477403cabf4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:57.788155 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e6f724b5-b2d9-479b-a86e-2477403cabf4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:57.807188 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e6f724b5-b2d9-479b-a86e-2477403cabf4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:57.808002 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e6f724b5-b2d9-479b-a86e-2477403cabf4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:57.809359 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e6f724b5-b2d9-479b-a86e-2477403cabf4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:57.810331 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e6f724b5-b2d9-479b-a86e-2477403cabf4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:57.933282 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e6f724b5-b2d9-479b-a86e-2477403cabf4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 17861 microversion: 2.20 time: 0.154809 Nov 16 00:29:57.937214 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 84/181] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:29:57 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 17861 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:29:58.022330 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-035a413e-8acd-4cc3-a6b0-34df1fa26923 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:58.024063 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-035a413e-8acd-4cc3-a6b0-34df1fa26923 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:58.034994 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-035a413e-8acd-4cc3-a6b0-34df1fa26923 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:58.036077 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-035a413e-8acd-4cc3-a6b0-34df1fa26923 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:58.037944 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-035a413e-8acd-4cc3-a6b0-34df1fa26923 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:58.038737 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-035a413e-8acd-4cc3-a6b0-34df1fa26923 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:58.140315 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-035a413e-8acd-4cc3-a6b0-34df1fa26923 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 14 microversion: 2.1 time: 0.125323 Nov 16 00:29:58.141235 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 98/182] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:29:58 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:29:58.609764 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0ff8437c-2131-4a52-910b-f636da323410 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:58.610729 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0ff8437c-2131-4a52-910b-f636da323410 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:58.620946 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0ff8437c-2131-4a52-910b-f636da323410 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:58.621946 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0ff8437c-2131-4a52-910b-f636da323410 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:58.623038 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0ff8437c-2131-4a52-910b-f636da323410 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:58.623854 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0ff8437c-2131-4a52-910b-f636da323410 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:58.873550 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0ff8437c-2131-4a52-910b-f636da323410 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:29:58.883595 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0ff8437c-2131-4a52-910b-f636da323410 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.279164 Nov 16 00:29:58.884542 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 85/183] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:58 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:29:58.952545 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-59e5fbac-2948-4741-bfa5-ae5f08aac006 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:58.954010 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-59e5fbac-2948-4741-bfa5-ae5f08aac006 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:58.964082 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-59e5fbac-2948-4741-bfa5-ae5f08aac006 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:58.964877 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-59e5fbac-2948-4741-bfa5-ae5f08aac006 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:58.966006 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-59e5fbac-2948-4741-bfa5-ae5f08aac006 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:58.967423 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-59e5fbac-2948-4741-bfa5-ae5f08aac006 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:59.085551 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-59e5fbac-2948-4741-bfa5-ae5f08aac006 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 17968 microversion: 2.20 time: 0.137897 Nov 16 00:29:59.088372 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 99/184] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:29:58 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 17968 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:29:59.161961 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e86a431d-9aac-4191-a3a8-da557ae4304d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:29:59.161961 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e86a431d-9aac-4191-a3a8-da557ae4304d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:59.167510 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e86a431d-9aac-4191-a3a8-da557ae4304d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:59.168287 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e86a431d-9aac-4191-a3a8-da557ae4304d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:59.171742 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e86a431d-9aac-4191-a3a8-da557ae4304d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:59.172933 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e86a431d-9aac-4191-a3a8-da557ae4304d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:59.309245 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e86a431d-9aac-4191-a3a8-da557ae4304d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 14 microversion: 2.1 time: 0.158941 Nov 16 00:29:59.313700 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 86/185] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:29:59 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:29:59.907255 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f8d3b100-6c3e-4eed-92f0-c314e463f525 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:29:59.909404 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f8d3b100-6c3e-4eed-92f0-c314e463f525 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:29:59.922626 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f8d3b100-6c3e-4eed-92f0-c314e463f525 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:59.923795 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f8d3b100-6c3e-4eed-92f0-c314e463f525 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:29:59.926639 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f8d3b100-6c3e-4eed-92f0-c314e463f525 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:29:59.927931 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f8d3b100-6c3e-4eed-92f0-c314e463f525 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:00.108875 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3f756f9f-c381-442b-a33a-4baaed5c4ace tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:00.112619 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3f756f9f-c381-442b-a33a-4baaed5c4ace tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:00.154920 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3f756f9f-c381-442b-a33a-4baaed5c4ace tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:00.155909 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3f756f9f-c381-442b-a33a-4baaed5c4ace tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:00.160046 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3f756f9f-c381-442b-a33a-4baaed5c4ace tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:00.160833 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3f756f9f-c381-442b-a33a-4baaed5c4ace tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:00.222141 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f8d3b100-6c3e-4eed-92f0-c314e463f525 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:00.231560 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f8d3b100-6c3e-4eed-92f0-c314e463f525 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.331966 Nov 16 00:30:00.232269 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 100/186] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:29:59 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:30:00.286236 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-3f756f9f-c381-442b-a33a-4baaed5c4ace tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 19342 microversion: 2.20 time: 0.189853 Nov 16 00:30:00.292155 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 87/187] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:00 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 19342 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:30:00.324228 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-a592e2f0-c29d-4995-ab1d-81847e4d7b70 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:00.326207 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-a592e2f0-c29d-4995-ab1d-81847e4d7b70 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:00.337024 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a592e2f0-c29d-4995-ab1d-81847e4d7b70 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:00.338477 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a592e2f0-c29d-4995-ab1d-81847e4d7b70 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:00.340481 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a592e2f0-c29d-4995-ab1d-81847e4d7b70 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:00.341248 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a592e2f0-c29d-4995-ab1d-81847e4d7b70 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:01.249865 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-ca279ca8-ca2e-4995-8c31-070c1f785ee6 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:01.250736 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-ca279ca8-ca2e-4995-8c31-070c1f785ee6 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:01.259938 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ca279ca8-ca2e-4995-8c31-070c1f785ee6 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:01.260787 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ca279ca8-ca2e-4995-8c31-070c1f785ee6 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:01.262103 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ca279ca8-ca2e-4995-8c31-070c1f785ee6 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:01.262637 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ca279ca8-ca2e-4995-8c31-070c1f785ee6 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:01.465986 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-ca279ca8-ca2e-4995-8c31-070c1f785ee6 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:01.482177 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-ca279ca8-ca2e-4995-8c31-070c1f785ee6 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.232009 Nov 16 00:30:01.483619 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 88/188] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:01 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:30:01.490304 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-2b42583c-ccec-4cd7-af84-483c8c245955 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:01.492514 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-2b42583c-ccec-4cd7-af84-483c8c245955 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:01.502512 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2b42583c-ccec-4cd7-af84-483c8c245955 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:01.503220 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2b42583c-ccec-4cd7-af84-483c8c245955 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:01.504564 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2b42583c-ccec-4cd7-af84-483c8c245955 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:01.505304 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2b42583c-ccec-4cd7-af84-483c8c245955 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:03.345158 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-a592e2f0-c29d-4995-ab1d-81847e4d7b70 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 14 microversion: 2.1 time: 3.026191 Nov 16 00:30:03.347838 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 101/189] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:00 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 14 bytes in 3030 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:30:03.353809 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-71b69b44-9aa5-4996-9bd4-da6f48387e32 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:03.354845 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-71b69b44-9aa5-4996-9bd4-da6f48387e32 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:03.365542 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-71b69b44-9aa5-4996-9bd4-da6f48387e32 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:03.366404 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-71b69b44-9aa5-4996-9bd4-da6f48387e32 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:03.367383 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-71b69b44-9aa5-4996-9bd4-da6f48387e32 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:03.367816 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-71b69b44-9aa5-4996-9bd4-da6f48387e32 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:03.368938 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-2b42583c-ccec-4cd7-af84-483c8c245955 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 23780 microversion: 2.20 time: 1.882825 Nov 16 00:30:03.370078 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 89/190] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:01 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 23780 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:30:03.526706 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-71b69b44-9aa5-4996-9bd4-da6f48387e32 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:03.540319 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-71b69b44-9aa5-4996-9bd4-da6f48387e32 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.190563 Nov 16 00:30:03.541322 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 102/191] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:03 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:04.363792 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-1ab46da6-294d-4302-906e-0e3a5f064ff9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:04.365070 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-1ab46da6-294d-4302-906e-0e3a5f064ff9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:04.376970 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1ab46da6-294d-4302-906e-0e3a5f064ff9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:04.377963 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1ab46da6-294d-4302-906e-0e3a5f064ff9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:04.379174 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1ab46da6-294d-4302-906e-0e3a5f064ff9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:04.379955 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1ab46da6-294d-4302-906e-0e3a5f064ff9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:04.384610 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-454cc4ec-e20c-4013-bfe3-ca2967106099 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:04.385747 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-454cc4ec-e20c-4013-bfe3-ca2967106099 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:04.394857 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-454cc4ec-e20c-4013-bfe3-ca2967106099 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:04.396136 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-454cc4ec-e20c-4013-bfe3-ca2967106099 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:04.397959 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-454cc4ec-e20c-4013-bfe3-ca2967106099 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:04.398745 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-454cc4ec-e20c-4013-bfe3-ca2967106099 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:06.772669 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-1ab46da6-294d-4302-906e-0e3a5f064ff9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 6795 microversion: 2.1 time: 2.414891 Nov 16 00:30:06.773914 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 90/192] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:04 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 6795 bytes in 2417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:06.779340 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d51af038-3848-47e0-b88b-e1987675b036 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:06.780045 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d51af038-3848-47e0-b88b-e1987675b036 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:06.787312 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d51af038-3848-47e0-b88b-e1987675b036 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:06.787791 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d51af038-3848-47e0-b88b-e1987675b036 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:06.788664 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d51af038-3848-47e0-b88b-e1987675b036 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:06.789100 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d51af038-3848-47e0-b88b-e1987675b036 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:06.796427 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-454cc4ec-e20c-4013-bfe3-ca2967106099 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 26084 microversion: 2.20 time: 2.415635 Nov 16 00:30:06.797810 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 103/193] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:04 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 26084 bytes in 2418 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:30:06.941733 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d51af038-3848-47e0-b88b-e1987675b036 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:06.950034 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d51af038-3848-47e0-b88b-e1987675b036 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.174706 Nov 16 00:30:06.950718 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 91/194] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:06 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:07.787620 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-84ff2c95-422b-467f-906c-ac27bf870947 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:07.788751 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-84ff2c95-422b-467f-906c-ac27bf870947 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:07.795841 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-84ff2c95-422b-467f-906c-ac27bf870947 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:07.796282 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-84ff2c95-422b-467f-906c-ac27bf870947 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:07.797068 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-84ff2c95-422b-467f-906c-ac27bf870947 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:07.797646 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-84ff2c95-422b-467f-906c-ac27bf870947 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:07.814785 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-175eed39-5cf9-48d1-b331-19138de83b8d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:07.816405 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-175eed39-5cf9-48d1-b331-19138de83b8d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:07.826990 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-175eed39-5cf9-48d1-b331-19138de83b8d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:07.827755 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-175eed39-5cf9-48d1-b331-19138de83b8d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:07.828809 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-175eed39-5cf9-48d1-b331-19138de83b8d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:07.829579 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-175eed39-5cf9-48d1-b331-19138de83b8d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:07.898634 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-84ff2c95-422b-467f-906c-ac27bf870947 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 12093 microversion: 2.1 time: 0.116235 Nov 16 00:30:07.899330 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 104/195] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:07 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 12093 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:30:07.945191 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-175eed39-5cf9-48d1-b331-19138de83b8d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 26741 microversion: 2.20 time: 0.137576 Nov 16 00:30:07.946307 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 92/196] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:07 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 26741 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:30:07.975448 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-65154f5d-5b9c-42a4-bb08-4bc2c0573808 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:07.976740 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-65154f5d-5b9c-42a4-bb08-4bc2c0573808 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:07.988765 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-65154f5d-5b9c-42a4-bb08-4bc2c0573808 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:07.989487 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-65154f5d-5b9c-42a4-bb08-4bc2c0573808 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:07.990882 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-65154f5d-5b9c-42a4-bb08-4bc2c0573808 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:07.991645 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-65154f5d-5b9c-42a4-bb08-4bc2c0573808 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:08.238918 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-65154f5d-5b9c-42a4-bb08-4bc2c0573808 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:08.262148 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-65154f5d-5b9c-42a4-bb08-4bc2c0573808 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.295400 Nov 16 00:30:08.272930 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 105/197] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:07 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:08.912488 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-79128949-2e39-43d7-8356-7ed2836faed6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:08.913941 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-79128949-2e39-43d7-8356-7ed2836faed6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:08.923391 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-79128949-2e39-43d7-8356-7ed2836faed6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:08.924152 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-79128949-2e39-43d7-8356-7ed2836faed6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:08.925172 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-79128949-2e39-43d7-8356-7ed2836faed6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:08.926001 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-79128949-2e39-43d7-8356-7ed2836faed6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:08.965246 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-0d07c357-d32b-48e4-b70a-bc14d9871067 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:08.978467 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-0d07c357-d32b-48e4-b70a-bc14d9871067 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:08.993462 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0d07c357-d32b-48e4-b70a-bc14d9871067 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:08.994322 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0d07c357-d32b-48e4-b70a-bc14d9871067 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:08.995860 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0d07c357-d32b-48e4-b70a-bc14d9871067 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:08.996709 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0d07c357-d32b-48e4-b70a-bc14d9871067 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:11.574226 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-79128949-2e39-43d7-8356-7ed2836faed6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 21840 microversion: 2.1 time: 2.667315 Nov 16 00:30:11.575184 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 93/198] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:08 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 21840 bytes in 2670 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:30:11.581864 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-926ff26e-b9b9-43c6-943c-79ace520ac5d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:11.582597 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-926ff26e-b9b9-43c6-943c-79ace520ac5d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:11.590026 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-926ff26e-b9b9-43c6-943c-79ace520ac5d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:11.590781 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-926ff26e-b9b9-43c6-943c-79ace520ac5d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:11.591604 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-926ff26e-b9b9-43c6-943c-79ace520ac5d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:11.592485 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-926ff26e-b9b9-43c6-943c-79ace520ac5d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:11.597065 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-0d07c357-d32b-48e4-b70a-bc14d9871067 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 27840 microversion: 2.20 time: 2.637849 Nov 16 00:30:11.599225 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 106/199] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:08 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 27840 bytes in 2643 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:30:11.824631 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-926ff26e-b9b9-43c6-943c-79ace520ac5d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:11.837483 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-926ff26e-b9b9-43c6-943c-79ace520ac5d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.260464 Nov 16 00:30:11.838068 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 94/200] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:11 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:12.587900 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-516fabaa-e139-483c-9d5e-13aef4d4530f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:12.589080 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-516fabaa-e139-483c-9d5e-13aef4d4530f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:12.596762 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-516fabaa-e139-483c-9d5e-13aef4d4530f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:12.597200 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-516fabaa-e139-483c-9d5e-13aef4d4530f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:12.598095 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-516fabaa-e139-483c-9d5e-13aef4d4530f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:12.598385 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-516fabaa-e139-483c-9d5e-13aef4d4530f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:12.613947 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-cfb8fd92-82b0-4c32-a255-8d7b51a35b08 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:12.615524 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-cfb8fd92-82b0-4c32-a255-8d7b51a35b08 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:12.624071 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cfb8fd92-82b0-4c32-a255-8d7b51a35b08 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:12.624770 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cfb8fd92-82b0-4c32-a255-8d7b51a35b08 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:12.625674 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cfb8fd92-82b0-4c32-a255-8d7b51a35b08 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:12.626178 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cfb8fd92-82b0-4c32-a255-8d7b51a35b08 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:12.702318 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-516fabaa-e139-483c-9d5e-13aef4d4530f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 22965 microversion: 2.1 time: 0.119207 Nov 16 00:30:12.707846 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 107/201] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:12 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 22965 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:30:12.728250 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-cfb8fd92-82b0-4c32-a255-8d7b51a35b08 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 28202 microversion: 2.20 time: 0.121276 Nov 16 00:30:12.729830 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 95/202] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:12 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 28202 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:30:12.875035 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-7591ff3f-e7d1-4043-9f2c-5c0efa2a71e0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:12.880069 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-7591ff3f-e7d1-4043-9f2c-5c0efa2a71e0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:12.892327 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7591ff3f-e7d1-4043-9f2c-5c0efa2a71e0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:12.892819 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7591ff3f-e7d1-4043-9f2c-5c0efa2a71e0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:12.894141 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7591ff3f-e7d1-4043-9f2c-5c0efa2a71e0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:12.894920 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7591ff3f-e7d1-4043-9f2c-5c0efa2a71e0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:13.192797 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-7591ff3f-e7d1-4043-9f2c-5c0efa2a71e0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:13.210703 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-7591ff3f-e7d1-4043-9f2c-5c0efa2a71e0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.338458 Nov 16 00:30:13.211604 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 108/203] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:12 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:13.717299 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3d31e037-540e-4da1-92bf-1df71c0be0c0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:13.718547 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3d31e037-540e-4da1-92bf-1df71c0be0c0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:13.726337 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3d31e037-540e-4da1-92bf-1df71c0be0c0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:13.726873 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3d31e037-540e-4da1-92bf-1df71c0be0c0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:13.727861 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3d31e037-540e-4da1-92bf-1df71c0be0c0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:13.728300 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3d31e037-540e-4da1-92bf-1df71c0be0c0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:13.741730 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-213421c9-070e-403b-b925-bb719b01734b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:13.742725 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-213421c9-070e-403b-b925-bb719b01734b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:13.754914 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-213421c9-070e-403b-b925-bb719b01734b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:13.754914 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-213421c9-070e-403b-b925-bb719b01734b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:13.754914 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-213421c9-070e-403b-b925-bb719b01734b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:13.754914 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-213421c9-070e-403b-b925-bb719b01734b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:16.118606 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-3d31e037-540e-4da1-92bf-1df71c0be0c0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 26695 microversion: 2.1 time: 2.405616 Nov 16 00:30:16.123863 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 96/204] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:13 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 26695 bytes in 2408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:30:16.131153 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-2fc82bdb-cc8f-49e0-a5fa-1e5841fa476b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:16.132441 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-2fc82bdb-cc8f-49e0-a5fa-1e5841fa476b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:16.144926 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2fc82bdb-cc8f-49e0-a5fa-1e5841fa476b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:16.145811 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2fc82bdb-cc8f-49e0-a5fa-1e5841fa476b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:16.147036 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2fc82bdb-cc8f-49e0-a5fa-1e5841fa476b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:16.147901 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2fc82bdb-cc8f-49e0-a5fa-1e5841fa476b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:16.339584 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-213421c9-070e-403b-b925-bb719b01734b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 28202 microversion: 2.20 time: 2.601161 Nov 16 00:30:16.348326 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 109/205] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:13 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 28202 bytes in 2611 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:30:16.357485 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-2fc82bdb-cc8f-49e0-a5fa-1e5841fa476b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:16.367773 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-2fc82bdb-cc8f-49e0-a5fa-1e5841fa476b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.245882 Nov 16 00:30:16.368582 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 97/206] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:16 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:17.133532 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f3ab123e-e774-4af9-96d4-50dda8010a87 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:17.134645 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f3ab123e-e774-4af9-96d4-50dda8010a87 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:17.144026 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f3ab123e-e774-4af9-96d4-50dda8010a87 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:17.144618 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f3ab123e-e774-4af9-96d4-50dda8010a87 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:17.145504 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f3ab123e-e774-4af9-96d4-50dda8010a87 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:17.146009 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f3ab123e-e774-4af9-96d4-50dda8010a87 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:17.251603 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f3ab123e-e774-4af9-96d4-50dda8010a87 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 27130 microversion: 2.1 time: 0.121868 Nov 16 00:30:17.257399 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 110/207] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:17 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 27130 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:30:17.355079 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-6422264e-a2b9-46e7-9ea8-017bf2ca05df tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:17.356018 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-6422264e-a2b9-46e7-9ea8-017bf2ca05df tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:17.363544 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6422264e-a2b9-46e7-9ea8-017bf2ca05df tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:17.363985 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6422264e-a2b9-46e7-9ea8-017bf2ca05df tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:17.364775 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6422264e-a2b9-46e7-9ea8-017bf2ca05df tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:17.365226 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6422264e-a2b9-46e7-9ea8-017bf2ca05df tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:17.386618 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f99e4bdd-9d71-4818-8465-a450f2aa845c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:17.387361 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f99e4bdd-9d71-4818-8465-a450f2aa845c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:17.397761 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f99e4bdd-9d71-4818-8465-a450f2aa845c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:17.398492 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f99e4bdd-9d71-4818-8465-a450f2aa845c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:17.399326 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f99e4bdd-9d71-4818-8465-a450f2aa845c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:17.399780 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f99e4bdd-9d71-4818-8465-a450f2aa845c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:17.540202 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f99e4bdd-9d71-4818-8465-a450f2aa845c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:17.548632 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f99e4bdd-9d71-4818-8465-a450f2aa845c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1521 microversion: 2.1 time: 0.165484 Nov 16 00:30:17.549240 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 111/208] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:17 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:30:18.264785 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-389f52f5-8e37-40ff-ac51-fcbbf80680a7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:18.265851 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-389f52f5-8e37-40ff-ac51-fcbbf80680a7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:18.272674 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-389f52f5-8e37-40ff-ac51-fcbbf80680a7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:18.273122 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-389f52f5-8e37-40ff-ac51-fcbbf80680a7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:18.273885 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-389f52f5-8e37-40ff-ac51-fcbbf80680a7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:18.274315 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-389f52f5-8e37-40ff-ac51-fcbbf80680a7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:20.331815 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-6422264e-a2b9-46e7-9ea8-017bf2ca05df tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 28202 microversion: 2.20 time: 2.980163 Nov 16 00:30:20.332892 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 98/209] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:17 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 28202 bytes in 2982 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:30:20.344089 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a52eff56-bc2f-44ff-851c-3cecc724be49 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:20.346523 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a52eff56-bc2f-44ff-851c-3cecc724be49 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:20.356245 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-389f52f5-8e37-40ff-ac51-fcbbf80680a7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 27938 microversion: 2.1 time: 2.094557 Nov 16 00:30:20.357688 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 112/210] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:18 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 27938 bytes in 2098 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:30:20.373161 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a52eff56-bc2f-44ff-851c-3cecc724be49 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:20.373880 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a52eff56-bc2f-44ff-851c-3cecc724be49 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:20.375247 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a52eff56-bc2f-44ff-851c-3cecc724be49 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:20.380702 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a52eff56-bc2f-44ff-851c-3cecc724be49 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:20.567102 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a52eff56-bc2f-44ff-851c-3cecc724be49 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:20.576267 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a52eff56-bc2f-44ff-851c-3cecc724be49 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1501 microversion: 2.1 time: 0.239137 Nov 16 00:30:20.577218 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 99/211] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:20 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1501 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:20.606715 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-e02f7012-b5a6-42c5-901c-4c9543245750 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:20.607797 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-e02f7012-b5a6-42c5-901c-4c9543245750 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:20.619404 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e02f7012-b5a6-42c5-901c-4c9543245750 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:20.620148 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e02f7012-b5a6-42c5-901c-4c9543245750 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:20.621484 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e02f7012-b5a6-42c5-901c-4c9543245750 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:20.622095 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e02f7012-b5a6-42c5-901c-4c9543245750 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:20.817950 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e02f7012-b5a6-42c5-901c-4c9543245750 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:20.825750 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-e02f7012-b5a6-42c5-901c-4c9543245750 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1514 microversion: 2.1 time: 0.225723 Nov 16 00:30:20.826434 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 113/212] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:20 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1514 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:21.352526 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-58223aba-f42a-4e07-a82a-55b3b37ed2b7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:21.355656 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-58223aba-f42a-4e07-a82a-55b3b37ed2b7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:21.368052 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-58223aba-f42a-4e07-a82a-55b3b37ed2b7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:21.369595 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-58223aba-f42a-4e07-a82a-55b3b37ed2b7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:21.371256 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-58223aba-f42a-4e07-a82a-55b3b37ed2b7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:21.372519 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-58223aba-f42a-4e07-a82a-55b3b37ed2b7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:21.375882 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-5f289588-c8bd-4889-8e31-3f75b1d5d4c1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:21.377967 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-5f289588-c8bd-4889-8e31-3f75b1d5d4c1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:21.389231 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5f289588-c8bd-4889-8e31-3f75b1d5d4c1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:21.389676 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5f289588-c8bd-4889-8e31-3f75b1d5d4c1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:21.393366 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5f289588-c8bd-4889-8e31-3f75b1d5d4c1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:21.393857 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5f289588-c8bd-4889-8e31-3f75b1d5d4c1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:23.654628 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-5f289588-c8bd-4889-8e31-3f75b1d5d4c1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 28116 microversion: 2.1 time: 2.282147 Nov 16 00:30:23.661493 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 114/213] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:21 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 28116 bytes in 2290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:30:23.661742 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-58223aba-f42a-4e07-a82a-55b3b37ed2b7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 28202 microversion: 2.20 time: 2.317999 Nov 16 00:30:23.662383 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 100/214] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:21 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 28202 bytes in 2320 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:30:24.672388 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-061f27cf-06d4-41fd-93c5-170442bfd35c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:24.674232 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-061f27cf-06d4-41fd-93c5-170442bfd35c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:24.684612 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-aa361330-b9e7-4a37-8b54-53417b6b8292 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:24.686485 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-aa361330-b9e7-4a37-8b54-53417b6b8292 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:24.686843 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-061f27cf-06d4-41fd-93c5-170442bfd35c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:24.687616 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-061f27cf-06d4-41fd-93c5-170442bfd35c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:24.689491 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-061f27cf-06d4-41fd-93c5-170442bfd35c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:24.690304 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-061f27cf-06d4-41fd-93c5-170442bfd35c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:24.700520 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-aa361330-b9e7-4a37-8b54-53417b6b8292 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:24.701605 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-aa361330-b9e7-4a37-8b54-53417b6b8292 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:24.703441 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-aa361330-b9e7-4a37-8b54-53417b6b8292 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:24.704757 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-aa361330-b9e7-4a37-8b54-53417b6b8292 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:26.877695 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-061f27cf-06d4-41fd-93c5-170442bfd35c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 28298 microversion: 2.1 time: 2.212136 Nov 16 00:30:26.878467 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 115/215] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:24 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 28298 bytes in 2214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:30:26.911373 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-aa361330-b9e7-4a37-8b54-53417b6b8292 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 28202 microversion: 2.20 time: 2.236434 Nov 16 00:30:26.912050 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 101/216] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:24 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 28202 bytes in 2241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:30:27.856697 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f2600c82-bed7-4c6f-8b81-29489f816a38 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:27.857828 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f2600c82-bed7-4c6f-8b81-29489f816a38 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:27.866510 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f2600c82-bed7-4c6f-8b81-29489f816a38 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:27.867261 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f2600c82-bed7-4c6f-8b81-29489f816a38 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:27.867843 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f2600c82-bed7-4c6f-8b81-29489f816a38 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:27.868328 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f2600c82-bed7-4c6f-8b81-29489f816a38 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:27.895669 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f0e4d0ee-698c-4e75-9456-cb4ce7f5c63b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:27.899082 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f0e4d0ee-698c-4e75-9456-cb4ce7f5c63b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:27.913368 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f0e4d0ee-698c-4e75-9456-cb4ce7f5c63b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:27.915839 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f0e4d0ee-698c-4e75-9456-cb4ce7f5c63b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:27.917596 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f0e4d0ee-698c-4e75-9456-cb4ce7f5c63b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:27.918681 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f0e4d0ee-698c-4e75-9456-cb4ce7f5c63b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:27.932055 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.objects.instance [None req-f2600c82-bed7-4c6f-8b81-29489f816a38 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lazy-loading 'flavor' on Instance uuid 896600e3-829b-43f9-87af-60d271f05432 {{(pid=122543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:30:28.026290 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-f0e4d0ee-698c-4e75-9456-cb4ce7f5c63b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 28298 microversion: 2.1 time: 0.139013 Nov 16 00:30:28.027270 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 102/217] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:27 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 28298 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:30:28.038421 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-c3d36ffd-1bc2-4709-82fb-d34041a93743 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:28.040601 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-c3d36ffd-1bc2-4709-82fb-d34041a93743 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:28.051351 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c3d36ffd-1bc2-4709-82fb-d34041a93743 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:28.052400 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c3d36ffd-1bc2-4709-82fb-d34041a93743 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:28.053979 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c3d36ffd-1bc2-4709-82fb-d34041a93743 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:28.054750 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c3d36ffd-1bc2-4709-82fb-d34041a93743 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:28.092809 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f2600c82-bed7-4c6f-8b81-29489f816a38 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "POST /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432/action" status: 200 len: 32 microversion: 2.1 time: 0.240041 Nov 16 00:30:28.093825 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 116/218] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:27 2021] POST /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432/action => generated 32 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 16 00:30:28.112213 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c26c02bb-2e38-4e24-8798-512cbf91cec7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:28.112926 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c26c02bb-2e38-4e24-8798-512cbf91cec7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:28.120109 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c26c02bb-2e38-4e24-8798-512cbf91cec7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:28.121010 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c26c02bb-2e38-4e24-8798-512cbf91cec7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:28.122042 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c26c02bb-2e38-4e24-8798-512cbf91cec7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:28.122880 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c26c02bb-2e38-4e24-8798-512cbf91cec7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:28.192187 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-c3d36ffd-1bc2-4709-82fb-d34041a93743 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 28492 microversion: 2.20 time: 0.162372 Nov 16 00:30:28.192964 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 103/219] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:28 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 28492 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:30:28.518394 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c26c02bb-2e38-4e24-8798-512cbf91cec7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:28.531264 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c26c02bb-2e38-4e24-8798-512cbf91cec7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.423769 Nov 16 00:30:28.534311 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 117/220] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:28 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:29.044573 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-597de659-a7a4-4b6c-8428-a4454c7af38d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:29.045778 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-597de659-a7a4-4b6c-8428-a4454c7af38d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:29.055106 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-597de659-a7a4-4b6c-8428-a4454c7af38d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:29.055844 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-597de659-a7a4-4b6c-8428-a4454c7af38d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:29.056924 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-597de659-a7a4-4b6c-8428-a4454c7af38d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:29.057764 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-597de659-a7a4-4b6c-8428-a4454c7af38d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:29.158276 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-597de659-a7a4-4b6c-8428-a4454c7af38d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 28323 microversion: 2.1 time: 0.117646 Nov 16 00:30:29.164607 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 104/221] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:29 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 28323 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:30:29.214248 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-4071ae96-c725-4083-bf64-33ceb8b92df1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:29.217023 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-4071ae96-c725-4083-bf64-33ceb8b92df1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:29.233965 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4071ae96-c725-4083-bf64-33ceb8b92df1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:29.235719 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4071ae96-c725-4083-bf64-33ceb8b92df1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:29.237668 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4071ae96-c725-4083-bf64-33ceb8b92df1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:29.238613 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4071ae96-c725-4083-bf64-33ceb8b92df1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:29.371610 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-4071ae96-c725-4083-bf64-33ceb8b92df1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 28615 microversion: 2.20 time: 0.168262 Nov 16 00:30:29.372785 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 118/222] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:29 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 28615 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:30:29.559022 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f8222f77-18e8-46fe-8fef-990efe9b2c5a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:29.560770 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f8222f77-18e8-46fe-8fef-990efe9b2c5a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:29.575442 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f8222f77-18e8-46fe-8fef-990efe9b2c5a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:29.576868 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f8222f77-18e8-46fe-8fef-990efe9b2c5a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:29.578963 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f8222f77-18e8-46fe-8fef-990efe9b2c5a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:29.581871 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f8222f77-18e8-46fe-8fef-990efe9b2c5a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:29.816783 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-f8222f77-18e8-46fe-8fef-990efe9b2c5a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:29.836013 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-f8222f77-18e8-46fe-8fef-990efe9b2c5a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.285517 Nov 16 00:30:29.837486 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 105/223] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:29 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:30.175783 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-7467df6c-16e6-4b32-b4d1-1a681b2f6fd5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:30.177485 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-7467df6c-16e6-4b32-b4d1-1a681b2f6fd5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:30.186702 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7467df6c-16e6-4b32-b4d1-1a681b2f6fd5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:30.187146 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7467df6c-16e6-4b32-b4d1-1a681b2f6fd5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:30.187931 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7467df6c-16e6-4b32-b4d1-1a681b2f6fd5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:30.189198 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7467df6c-16e6-4b32-b4d1-1a681b2f6fd5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:30.280742 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-7467df6c-16e6-4b32-b4d1-1a681b2f6fd5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 28588 microversion: 2.1 time: 0.110898 Nov 16 00:30:30.281722 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 119/224] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:30 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 28588 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:30:30.386436 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3b86cb14-2e26-40ac-8a22-99a8a8919bed tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:30.387452 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3b86cb14-2e26-40ac-8a22-99a8a8919bed tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:30.394162 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3b86cb14-2e26-40ac-8a22-99a8a8919bed tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:30.394517 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3b86cb14-2e26-40ac-8a22-99a8a8919bed tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:30.395399 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3b86cb14-2e26-40ac-8a22-99a8a8919bed tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:30.395859 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3b86cb14-2e26-40ac-8a22-99a8a8919bed tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:30.487702 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-3b86cb14-2e26-40ac-8a22-99a8a8919bed tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 28660 microversion: 2.20 time: 0.105020 Nov 16 00:30:30.489069 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 106/225] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:30 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 28660 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:30:30.866479 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-e3dacb0b-fffa-4360-9256-78f548e712b2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:30.867509 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-e3dacb0b-fffa-4360-9256-78f548e712b2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:30.875888 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e3dacb0b-fffa-4360-9256-78f548e712b2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:30.877357 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e3dacb0b-fffa-4360-9256-78f548e712b2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:30.878686 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e3dacb0b-fffa-4360-9256-78f548e712b2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:30.879455 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e3dacb0b-fffa-4360-9256-78f548e712b2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:31.028171 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e3dacb0b-fffa-4360-9256-78f548e712b2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:31.036778 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-e3dacb0b-fffa-4360-9256-78f548e712b2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.174801 Nov 16 00:30:31.037403 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 120/226] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:30 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:30:31.294116 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-bee0c0f7-558d-4bf0-8710-693b095e5d68 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:31.295753 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-bee0c0f7-558d-4bf0-8710-693b095e5d68 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:31.304558 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bee0c0f7-558d-4bf0-8710-693b095e5d68 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:31.305051 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bee0c0f7-558d-4bf0-8710-693b095e5d68 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:31.306295 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bee0c0f7-558d-4bf0-8710-693b095e5d68 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:31.306738 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bee0c0f7-558d-4bf0-8710-693b095e5d68 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:31.403429 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-bee0c0f7-558d-4bf0-8710-693b095e5d68 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 28756 microversion: 2.1 time: 0.113518 Nov 16 00:30:31.405126 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 107/227] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:31 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 28756 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:30:31.503226 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-07951a9b-7dcb-48c8-a98e-b8ae0d9ac7d8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:31.505224 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-07951a9b-7dcb-48c8-a98e-b8ae0d9ac7d8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:31.519622 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-07951a9b-7dcb-48c8-a98e-b8ae0d9ac7d8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:31.520472 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-07951a9b-7dcb-48c8-a98e-b8ae0d9ac7d8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:31.522294 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-07951a9b-7dcb-48c8-a98e-b8ae0d9ac7d8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:31.523247 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-07951a9b-7dcb-48c8-a98e-b8ae0d9ac7d8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:31.640933 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-07951a9b-7dcb-48c8-a98e-b8ae0d9ac7d8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 28660 microversion: 2.20 time: 0.134059 Nov 16 00:30:31.643034 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 121/228] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:31 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 28660 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:30:32.056134 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-4a9c3d9e-d41b-497f-ba9a-b114c6296a85 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:32.057211 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-4a9c3d9e-d41b-497f-ba9a-b114c6296a85 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:32.064917 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4a9c3d9e-d41b-497f-ba9a-b114c6296a85 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:32.065844 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4a9c3d9e-d41b-497f-ba9a-b114c6296a85 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:32.066648 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4a9c3d9e-d41b-497f-ba9a-b114c6296a85 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:32.067185 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4a9c3d9e-d41b-497f-ba9a-b114c6296a85 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:32.229558 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-4a9c3d9e-d41b-497f-ba9a-b114c6296a85 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:32.239265 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-4a9c3d9e-d41b-497f-ba9a-b114c6296a85 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.187627 Nov 16 00:30:32.240016 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 108/229] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:32 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:32.419820 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-fe987dd0-c720-46a1-860d-46fde642c434 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:32.421007 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-fe987dd0-c720-46a1-860d-46fde642c434 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:32.430455 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fe987dd0-c720-46a1-860d-46fde642c434 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:32.430988 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fe987dd0-c720-46a1-860d-46fde642c434 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:32.431932 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fe987dd0-c720-46a1-860d-46fde642c434 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:32.432427 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fe987dd0-c720-46a1-860d-46fde642c434 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:32.660200 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-66951cc7-7919-45eb-b6d7-c3065eb3cd64 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:32.662849 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-66951cc7-7919-45eb-b6d7-c3065eb3cd64 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:32.674483 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-66951cc7-7919-45eb-b6d7-c3065eb3cd64 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:32.675287 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-66951cc7-7919-45eb-b6d7-c3065eb3cd64 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:32.676635 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-66951cc7-7919-45eb-b6d7-c3065eb3cd64 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:32.678227 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-66951cc7-7919-45eb-b6d7-c3065eb3cd64 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:34.390844 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-fe987dd0-c720-46a1-860d-46fde642c434 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 28756 microversion: 2.1 time: 1.975559 Nov 16 00:30:34.393192 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 122/230] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:32 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 28756 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:30:34.396733 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-66951cc7-7919-45eb-b6d7-c3065eb3cd64 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 28660 microversion: 2.20 time: 1.744218 Nov 16 00:30:34.398091 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 109/231] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:32 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 28660 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:30:34.398616 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-937a893c-57da-4044-aeb5-68f006019166 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:34.399345 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-937a893c-57da-4044-aeb5-68f006019166 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:34.406368 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-937a893c-57da-4044-aeb5-68f006019166 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:34.406799 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-937a893c-57da-4044-aeb5-68f006019166 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:34.408517 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-937a893c-57da-4044-aeb5-68f006019166 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:34.408753 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-937a893c-57da-4044-aeb5-68f006019166 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:34.572377 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-937a893c-57da-4044-aeb5-68f006019166 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:34.586291 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-937a893c-57da-4044-aeb5-68f006019166 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.191149 Nov 16 00:30:34.587198 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 123/232] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:34 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:35.312195 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-31c42f9a-4d28-41d6-a654-c375145c0aa7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-396553939", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2139507500", "security_groups": [{"name": "tempest-secgroup-smoke-1181632784"}], "block_device_mapping_v2": [{"uuid": "99665a2a-90a3-45c8-8018-6e5a66eac9d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5b2f5911-2804-41c1-a851-8f21bec631b6"}]}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:35.410648 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-77106d4b-ee6e-47e4-a722-e5edadb56d2f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:35.412335 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-77106d4b-ee6e-47e4-a722-e5edadb56d2f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:35.435664 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-77106d4b-ee6e-47e4-a722-e5edadb56d2f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:35.435664 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-77106d4b-ee6e-47e4-a722-e5edadb56d2f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:35.435664 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-77106d4b-ee6e-47e4-a722-e5edadb56d2f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:35.435664 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-77106d4b-ee6e-47e4-a722-e5edadb56d2f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:35.545225 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-77106d4b-ee6e-47e4-a722-e5edadb56d2f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 28756 microversion: 2.1 time: 0.141433 Nov 16 00:30:35.547012 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 124/233] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:35 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 28756 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:30:35.559214 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-39aa7ddb-3fdc-4eb8-aaf2-d9bb93b6a832 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:35.561015 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-39aa7ddb-3fdc-4eb8-aaf2-d9bb93b6a832 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:35.565982 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.network.neutron [None req-31c42f9a-4d28-41d6-a654-c375145c0aa7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] validate_networks() for [('5b2f5911-2804-41c1-a851-8f21bec631b6', None, None, None, None, None)] {{(pid=122544) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:30:35.573524 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-39aa7ddb-3fdc-4eb8-aaf2-d9bb93b6a832 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:35.575218 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-39aa7ddb-3fdc-4eb8-aaf2-d9bb93b6a832 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:35.577001 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-39aa7ddb-3fdc-4eb8-aaf2-d9bb93b6a832 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:35.578014 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-39aa7ddb-3fdc-4eb8-aaf2-d9bb93b6a832 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:35.687956 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-39aa7ddb-3fdc-4eb8-aaf2-d9bb93b6a832 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 28660 microversion: 2.20 time: 0.137151 Nov 16 00:30:35.689671 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 125/234] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:35 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 28660 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:30:35.701811 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-e94aa179-bea8-4ffe-b6b9-f0bf1e4a9793 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:35.703148 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-e94aa179-bea8-4ffe-b6b9-f0bf1e4a9793 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:35.716007 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e94aa179-bea8-4ffe-b6b9-f0bf1e4a9793 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:35.717116 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e94aa179-bea8-4ffe-b6b9-f0bf1e4a9793 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:35.718789 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e94aa179-bea8-4ffe-b6b9-f0bf1e4a9793 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:35.720364 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e94aa179-bea8-4ffe-b6b9-f0bf1e4a9793 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:36.273758 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e94aa179-bea8-4ffe-b6b9-f0bf1e4a9793 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:36.321021 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-e94aa179-bea8-4ffe-b6b9-f0bf1e4a9793 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.629354 Nov 16 00:30:36.322867 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 126/235] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:35 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:36.381710 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-31c42f9a-4d28-41d6-a654-c375145c0aa7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Flavor limits 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:30:36.382363 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-31c42f9a-4d28-41d6-a654-c375145c0aa7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Image limits 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:30:36.383334 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-31c42f9a-4d28-41d6-a654-c375145c0aa7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Flavor pref 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:30:36.383980 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-31c42f9a-4d28-41d6-a654-c375145c0aa7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Image pref 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:30:36.384423 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-31c42f9a-4d28-41d6-a654-c375145c0aa7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:30:36.397202 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-31c42f9a-4d28-41d6-a654-c375145c0aa7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:36.397657 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-31c42f9a-4d28-41d6-a654-c375145c0aa7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:36.398496 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-31c42f9a-4d28-41d6-a654-c375145c0aa7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:36.398931 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-31c42f9a-4d28-41d6-a654-c375145c0aa7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:36.421588 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-31c42f9a-4d28-41d6-a654-c375145c0aa7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Getting quotas for project cce0078a151f47738c5863929c403dc7. Resources: {'instances', 'cores', 'ram'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:30:36.427525 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-31c42f9a-4d28-41d6-a654-c375145c0aa7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Getting quotas for user 5fa70de1eca24c8da180736ff9ebc553 and project cce0078a151f47738c5863929c403dc7. Resources: {'instances', 'cores', 'ram'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:30:36.513112 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-31c42f9a-4d28-41d6-a654-c375145c0aa7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Going to run 1 instances... {{(pid=122544) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:30:36.515726 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-31c42f9a-4d28-41d6-a654-c375145c0aa7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='99665a2a-90a3-45c8-8018-6e5a66eac9d8',volume_size=None,volume_type=None)] {{(pid=122544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:30:36.562320 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-6b56444d-bb4c-414a-af3d-80688399325c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:36.569392 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-6b56444d-bb4c-414a-af3d-80688399325c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:36.584225 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6b56444d-bb4c-414a-af3d-80688399325c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:36.584945 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6b56444d-bb4c-414a-af3d-80688399325c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:36.585977 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6b56444d-bb4c-414a-af3d-80688399325c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:36.586642 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6b56444d-bb4c-414a-af3d-80688399325c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:36.678752 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-6b56444d-bb4c-414a-af3d-80688399325c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 28756 microversion: 2.1 time: 0.123200 Nov 16 00:30:36.685696 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 127/236] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:36 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 28756 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:30:36.699512 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-31c42f9a-4d28-41d6-a654-c375145c0aa7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.392134 Nov 16 00:30:36.702843 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 110/237] 10.222.0.31 () {60 vars in 1146 bytes} [Tue Nov 16 00:30:35 2021] POST /compute/v2.1/servers => generated 406 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 16 00:30:36.711742 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-25e9f370-7b9a-48f1-8169-c0e7ececd4c4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:36.711919 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-25e9f370-7b9a-48f1-8169-c0e7ececd4c4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:36.736034 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-4f83e296-4c3d-4edb-8384-a3819c33e962 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:36.740745 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-4f83e296-4c3d-4edb-8384-a3819c33e962 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:36.756918 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4f83e296-4c3d-4edb-8384-a3819c33e962 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:36.757637 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4f83e296-4c3d-4edb-8384-a3819c33e962 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:36.758657 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4f83e296-4c3d-4edb-8384-a3819c33e962 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:36.768202 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4f83e296-4c3d-4edb-8384-a3819c33e962 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:36.830022 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-25e9f370-7b9a-48f1-8169-c0e7ececd4c4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:36.841950 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-25e9f370-7b9a-48f1-8169-c0e7ececd4c4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1094 microversion: 2.1 time: 0.134508 Nov 16 00:30:36.842757 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 111/238] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:36 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1094 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:30:36.871136 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-4f83e296-4c3d-4edb-8384-a3819c33e962 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 28660 microversion: 2.20 time: 0.169410 Nov 16 00:30:36.872715 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 128/239] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:36 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 28660 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:30:37.354520 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-63f239b7-2793-424c-a104-a78273e1fcba tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:37.355386 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-63f239b7-2793-424c-a104-a78273e1fcba tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:37.384723 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-63f239b7-2793-424c-a104-a78273e1fcba tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:37.387657 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-63f239b7-2793-424c-a104-a78273e1fcba tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:37.391286 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-63f239b7-2793-424c-a104-a78273e1fcba tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:37.392612 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-63f239b7-2793-424c-a104-a78273e1fcba tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:37.631308 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-63f239b7-2793-424c-a104-a78273e1fcba tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:37.646255 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-63f239b7-2793-424c-a104-a78273e1fcba tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.298680 Nov 16 00:30:37.647914 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 112/240] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:37 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:37.704878 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-645eeff1-f6fa-4c05-b078-5cda33e9c766 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:37.708787 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-645eeff1-f6fa-4c05-b078-5cda33e9c766 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:37.721849 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-645eeff1-f6fa-4c05-b078-5cda33e9c766 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:37.722579 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-645eeff1-f6fa-4c05-b078-5cda33e9c766 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:37.723940 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-645eeff1-f6fa-4c05-b078-5cda33e9c766 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:37.725210 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-645eeff1-f6fa-4c05-b078-5cda33e9c766 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:37.864559 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-edeb0ec8-502e-4d53-a85b-d646cfc18203 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:37.865181 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-edeb0ec8-502e-4d53-a85b-d646cfc18203 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:37.865422 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-645eeff1-f6fa-4c05-b078-5cda33e9c766 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 28756 microversion: 2.1 time: 0.172440 Nov 16 00:30:37.876110 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-edeb0ec8-502e-4d53-a85b-d646cfc18203 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:37.876946 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 129/241] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:37 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 28756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:30:37.880426 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-edeb0ec8-502e-4d53-a85b-d646cfc18203 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:37.881892 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-edeb0ec8-502e-4d53-a85b-d646cfc18203 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:37.882256 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-edeb0ec8-502e-4d53-a85b-d646cfc18203 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:37.892435 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-65a46b64-4728-4d22-a5d2-5bb16102e949 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:37.894381 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-65a46b64-4728-4d22-a5d2-5bb16102e949 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:37.912028 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-65a46b64-4728-4d22-a5d2-5bb16102e949 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:37.912744 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-65a46b64-4728-4d22-a5d2-5bb16102e949 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:37.914346 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-65a46b64-4728-4d22-a5d2-5bb16102e949 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:37.915130 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-65a46b64-4728-4d22-a5d2-5bb16102e949 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:38.034961 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-65a46b64-4728-4d22-a5d2-5bb16102e949 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 28675 microversion: 2.20 time: 0.152855 Nov 16 00:30:38.036654 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 130/242] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:37 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 28675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:30:38.045781 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-edeb0ec8-502e-4d53-a85b-d646cfc18203 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:38.058201 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-edeb0ec8-502e-4d53-a85b-d646cfc18203 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1192 microversion: 2.1 time: 0.198781 Nov 16 00:30:38.059342 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 113/243] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:37 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1192 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:30:38.675421 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-69c9abed-8cda-4bfb-a5c3-c695e9a1db78 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:38.676720 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-69c9abed-8cda-4bfb-a5c3-c695e9a1db78 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:38.684416 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-69c9abed-8cda-4bfb-a5c3-c695e9a1db78 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:38.685252 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-69c9abed-8cda-4bfb-a5c3-c695e9a1db78 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:38.687188 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-69c9abed-8cda-4bfb-a5c3-c695e9a1db78 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:38.687907 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-69c9abed-8cda-4bfb-a5c3-c695e9a1db78 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:38.889690 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-843565b2-fbae-43e3-88df-7e6776c4f683 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:38.893169 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-843565b2-fbae-43e3-88df-7e6776c4f683 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:38.910569 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-843565b2-fbae-43e3-88df-7e6776c4f683 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:38.911732 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-843565b2-fbae-43e3-88df-7e6776c4f683 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:38.912906 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-843565b2-fbae-43e3-88df-7e6776c4f683 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:38.913548 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-843565b2-fbae-43e3-88df-7e6776c4f683 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:39.015520 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-843565b2-fbae-43e3-88df-7e6776c4f683 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 29142 microversion: 2.1 time: 0.137632 Nov 16 00:30:39.019009 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 114/244] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:38 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 29142 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:30:39.054777 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-cc51a499-73f0-497c-90ae-6c519ab74576 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:39.056402 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-cc51a499-73f0-497c-90ae-6c519ab74576 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:39.080835 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cc51a499-73f0-497c-90ae-6c519ab74576 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:39.081758 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cc51a499-73f0-497c-90ae-6c519ab74576 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:39.083812 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cc51a499-73f0-497c-90ae-6c519ab74576 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:39.084855 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cc51a499-73f0-497c-90ae-6c519ab74576 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:39.114245 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-69c9abed-8cda-4bfb-a5c3-c695e9a1db78 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:39.138104 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-69c9abed-8cda-4bfb-a5c3-c695e9a1db78 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.468086 Nov 16 00:30:39.157969 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 131/245] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:38 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:30:39.166166 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-30484dd1-5eb9-4a63-b0bc-790050544beb tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:39.166934 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-30484dd1-5eb9-4a63-b0bc-790050544beb tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:39.173262 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-30484dd1-5eb9-4a63-b0bc-790050544beb tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:39.173711 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-30484dd1-5eb9-4a63-b0bc-790050544beb tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:39.174514 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-30484dd1-5eb9-4a63-b0bc-790050544beb tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:39.174947 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-30484dd1-5eb9-4a63-b0bc-790050544beb tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:39.213159 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-cc51a499-73f0-497c-90ae-6c519ab74576 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 30329 microversion: 2.20 time: 0.169113 Nov 16 00:30:39.214244 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 115/246] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:39 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 30329 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:30:39.371980 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-30484dd1-5eb9-4a63-b0bc-790050544beb tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:39.381477 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-30484dd1-5eb9-4a63-b0bc-790050544beb tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1198 microversion: 2.1 time: 0.222300 Nov 16 00:30:39.384752 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 132/247] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:39 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1198 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:40.039265 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-727fd04e-fdcb-4980-8b27-1af2feb3d2fc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:40.042079 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-727fd04e-fdcb-4980-8b27-1af2feb3d2fc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:40.058794 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-727fd04e-fdcb-4980-8b27-1af2feb3d2fc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:40.058794 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-727fd04e-fdcb-4980-8b27-1af2feb3d2fc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:40.058794 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-727fd04e-fdcb-4980-8b27-1af2feb3d2fc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:40.058794 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-727fd04e-fdcb-4980-8b27-1af2feb3d2fc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:40.154154 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-727fd04e-fdcb-4980-8b27-1af2feb3d2fc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 30659 microversion: 2.1 time: 0.120871 Nov 16 00:30:40.159800 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 116/248] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:40 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 30659 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:30:40.162399 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-6d881ce3-1900-4736-a0f3-b3e4d76feeb4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:40.165363 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-6d881ce3-1900-4736-a0f3-b3e4d76feeb4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:40.178735 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6d881ce3-1900-4736-a0f3-b3e4d76feeb4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:40.186026 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6d881ce3-1900-4736-a0f3-b3e4d76feeb4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:40.189779 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6d881ce3-1900-4736-a0f3-b3e4d76feeb4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:40.190019 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6d881ce3-1900-4736-a0f3-b3e4d76feeb4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:40.230156 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-b086bd89-53a5-4c67-a08e-de2f7d8a0ab3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:40.231537 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-b086bd89-53a5-4c67-a08e-de2f7d8a0ab3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:40.242302 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b086bd89-53a5-4c67-a08e-de2f7d8a0ab3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:40.243171 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b086bd89-53a5-4c67-a08e-de2f7d8a0ab3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:40.244804 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b086bd89-53a5-4c67-a08e-de2f7d8a0ab3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:40.245709 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b086bd89-53a5-4c67-a08e-de2f7d8a0ab3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:40.372941 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-b086bd89-53a5-4c67-a08e-de2f7d8a0ab3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 31786 microversion: 2.20 time: 0.147334 Nov 16 00:30:40.374053 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 117/249] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:40 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 31786 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:30:40.415692 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a35d0834-8148-4000-9c5d-f41e4ad41f67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:40.417017 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a35d0834-8148-4000-9c5d-f41e4ad41f67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:40.430412 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a35d0834-8148-4000-9c5d-f41e4ad41f67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:40.431716 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a35d0834-8148-4000-9c5d-f41e4ad41f67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:40.432820 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a35d0834-8148-4000-9c5d-f41e4ad41f67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:40.433621 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a35d0834-8148-4000-9c5d-f41e4ad41f67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:40.698896 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-6d881ce3-1900-4736-a0f3-b3e4d76feeb4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:40.731972 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-6d881ce3-1900-4736-a0f3-b3e4d76feeb4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.576482 Nov 16 00:30:40.734122 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 133/250] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:40 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:40.805485 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a35d0834-8148-4000-9c5d-f41e4ad41f67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:40.820082 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a35d0834-8148-4000-9c5d-f41e4ad41f67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1266 microversion: 2.1 time: 0.421819 Nov 16 00:30:40.822053 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 118/251] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:40 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1266 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:41.177034 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1ba64208-eaea-4f8a-a33d-b760c16fa56a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:41.181211 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1ba64208-eaea-4f8a-a33d-b760c16fa56a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:41.195851 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1ba64208-eaea-4f8a-a33d-b760c16fa56a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:41.197167 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1ba64208-eaea-4f8a-a33d-b760c16fa56a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:41.200380 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1ba64208-eaea-4f8a-a33d-b760c16fa56a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:41.202669 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1ba64208-eaea-4f8a-a33d-b760c16fa56a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:41.351656 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-1ba64208-eaea-4f8a-a33d-b760c16fa56a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 32440 microversion: 2.1 time: 0.184780 Nov 16 00:30:41.352813 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 134/252] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:41 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 32440 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:30:41.390157 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-126283a5-1d36-492b-971b-e75213fc6f44 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:41.392676 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-126283a5-1d36-492b-971b-e75213fc6f44 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:41.404391 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-126283a5-1d36-492b-971b-e75213fc6f44 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:41.404908 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-126283a5-1d36-492b-971b-e75213fc6f44 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:41.406317 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-126283a5-1d36-492b-971b-e75213fc6f44 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:41.408074 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-126283a5-1d36-492b-971b-e75213fc6f44 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:41.528351 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-360a8167-34bc-4725-8d79-7e6abd2d0c2f req-c141318c-bd43-4054-b6fb-84784e813122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e", "tag": "1a9e347e-ccd8-44e3-b595-51e076101a93"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:41.545500 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-126283a5-1d36-492b-971b-e75213fc6f44 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 33299 microversion: 2.20 time: 0.161256 Nov 16 00:30:41.555737 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:30:41.555737 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:30:41.564794 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 119/253] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:41 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 33299 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:30:41.579512 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-360a8167-34bc-4725-8d79-7e6abd2d0c2f req-c141318c-bd43-4054-b6fb-84784e813122 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:41.581103 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-360a8167-34bc-4725-8d79-7e6abd2d0c2f req-c141318c-bd43-4054-b6fb-84784e813122 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:41.608785 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-360a8167-34bc-4725-8d79-7e6abd2d0c2f req-c141318c-bd43-4054-b6fb-84784e813122 service nova] Creating event network-changed:1a9e347e-ccd8-44e3-b595-51e076101a93 for instance e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e on hv-cinder-81115 Nov 16 00:30:41.621779 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-360a8167-34bc-4725-8d79-7e6abd2d0c2f req-c141318c-bd43-4054-b6fb-84784e813122 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108427 Nov 16 00:30:41.623877 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 135/254] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:30:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:30:41.769071 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-249f2c7c-8cab-43e6-872a-fcc749687c37 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:41.772766 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-249f2c7c-8cab-43e6-872a-fcc749687c37 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:41.800267 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-249f2c7c-8cab-43e6-872a-fcc749687c37 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:41.801345 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-249f2c7c-8cab-43e6-872a-fcc749687c37 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:41.802842 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-249f2c7c-8cab-43e6-872a-fcc749687c37 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:41.804288 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-249f2c7c-8cab-43e6-872a-fcc749687c37 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:41.852639 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-770a0e85-e140-4c84-a724-92a33c922d31 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:41.863325 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-770a0e85-e140-4c84-a724-92a33c922d31 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:41.884397 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-770a0e85-e140-4c84-a724-92a33c922d31 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:41.897790 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-770a0e85-e140-4c84-a724-92a33c922d31 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:41.899843 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-770a0e85-e140-4c84-a724-92a33c922d31 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:41.901830 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-770a0e85-e140-4c84-a724-92a33c922d31 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:42.140617 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-249f2c7c-8cab-43e6-872a-fcc749687c37 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:42.155384 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-249f2c7c-8cab-43e6-872a-fcc749687c37 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.405967 Nov 16 00:30:42.157324 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 120/255] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:41 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:42.293298 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-770a0e85-e140-4c84-a724-92a33c922d31 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:42.308627 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-770a0e85-e140-4c84-a724-92a33c922d31 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1266 microversion: 2.1 time: 0.464150 Nov 16 00:30:42.310864 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 136/256] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:41 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1266 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:30:42.370229 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-1de01868-9ea4-4b5c-8023-23fefe66ddc7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:42.371950 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-1de01868-9ea4-4b5c-8023-23fefe66ddc7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:42.383512 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1de01868-9ea4-4b5c-8023-23fefe66ddc7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:42.384628 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1de01868-9ea4-4b5c-8023-23fefe66ddc7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:42.386270 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1de01868-9ea4-4b5c-8023-23fefe66ddc7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:42.387022 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1de01868-9ea4-4b5c-8023-23fefe66ddc7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:42.485504 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-1de01868-9ea4-4b5c-8023-23fefe66ddc7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 33452 microversion: 2.1 time: 0.121003 Nov 16 00:30:42.488501 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 121/257] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:42 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 33452 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:30:42.576624 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-cacc0c00-aea8-4324-a6c6-24fd05067f38 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:42.577520 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-cacc0c00-aea8-4324-a6c6-24fd05067f38 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:42.587800 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cacc0c00-aea8-4324-a6c6-24fd05067f38 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:42.588943 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cacc0c00-aea8-4324-a6c6-24fd05067f38 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:42.590433 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cacc0c00-aea8-4324-a6c6-24fd05067f38 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:42.591340 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cacc0c00-aea8-4324-a6c6-24fd05067f38 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:42.714055 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-cacc0c00-aea8-4324-a6c6-24fd05067f38 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 34077 microversion: 2.20 time: 0.144674 Nov 16 00:30:42.715489 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 137/258] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:42 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 34077 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:30:43.179559 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-6b251ef8-6f2e-438b-bbce-ae09a39d6d63 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:43.180708 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-6b251ef8-6f2e-438b-bbce-ae09a39d6d63 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:43.189368 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6b251ef8-6f2e-438b-bbce-ae09a39d6d63 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:43.190129 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6b251ef8-6f2e-438b-bbce-ae09a39d6d63 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:43.191206 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6b251ef8-6f2e-438b-bbce-ae09a39d6d63 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:43.191879 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6b251ef8-6f2e-438b-bbce-ae09a39d6d63 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:43.341844 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-cf7a4a45-ad90-42f3-9dd8-26741690252b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:43.348285 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-cf7a4a45-ad90-42f3-9dd8-26741690252b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:43.362498 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-6b251ef8-6f2e-438b-bbce-ae09a39d6d63 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:43.364566 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cf7a4a45-ad90-42f3-9dd8-26741690252b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:43.366073 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cf7a4a45-ad90-42f3-9dd8-26741690252b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:43.367965 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cf7a4a45-ad90-42f3-9dd8-26741690252b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:43.368883 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cf7a4a45-ad90-42f3-9dd8-26741690252b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:43.373857 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-6b251ef8-6f2e-438b-bbce-ae09a39d6d63 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.200157 Nov 16 00:30:43.378041 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 122/259] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:43 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:43.512611 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d1e0fc5e-e856-40ae-9d6f-de239e2b9ef4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:43.515439 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d1e0fc5e-e856-40ae-9d6f-de239e2b9ef4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:43.530415 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d1e0fc5e-e856-40ae-9d6f-de239e2b9ef4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:43.531731 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d1e0fc5e-e856-40ae-9d6f-de239e2b9ef4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:43.533735 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d1e0fc5e-e856-40ae-9d6f-de239e2b9ef4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:43.534780 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d1e0fc5e-e856-40ae-9d6f-de239e2b9ef4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:43.614771 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-cf7a4a45-ad90-42f3-9dd8-26741690252b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:43.631127 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-cf7a4a45-ad90-42f3-9dd8-26741690252b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1266 microversion: 2.1 time: 0.297509 Nov 16 00:30:43.632888 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 138/260] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:43 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:30:43.668164 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d1e0fc5e-e856-40ae-9d6f-de239e2b9ef4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 34180 microversion: 2.1 time: 0.168995 Nov 16 00:30:43.675558 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 123/261] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:43 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 34180 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:30:43.731433 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-4aa3325e-bda9-4bfb-bf87-8833fc5ebd76 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:43.733065 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-4aa3325e-bda9-4bfb-bf87-8833fc5ebd76 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:43.745511 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4aa3325e-bda9-4bfb-bf87-8833fc5ebd76 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:43.746389 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4aa3325e-bda9-4bfb-bf87-8833fc5ebd76 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:43.748124 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4aa3325e-bda9-4bfb-bf87-8833fc5ebd76 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:43.749222 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4aa3325e-bda9-4bfb-bf87-8833fc5ebd76 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:43.853887 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-4aa3325e-bda9-4bfb-bf87-8833fc5ebd76 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 35141 microversion: 2.20 time: 0.128678 Nov 16 00:30:43.854525 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 139/262] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:43 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 35141 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:30:44.404547 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-fb7c0ba6-9361-4b02-95b0-1666f6a81b70 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:44.405269 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-fb7c0ba6-9361-4b02-95b0-1666f6a81b70 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:44.421616 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-fb7c0ba6-9361-4b02-95b0-1666f6a81b70 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:44.423684 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-fb7c0ba6-9361-4b02-95b0-1666f6a81b70 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:44.424610 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-fb7c0ba6-9361-4b02-95b0-1666f6a81b70 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:44.425284 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-fb7c0ba6-9361-4b02-95b0-1666f6a81b70 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:44.631014 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-fb7c0ba6-9361-4b02-95b0-1666f6a81b70 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:44.656414 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-fb7c0ba6-9361-4b02-95b0-1666f6a81b70 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.256952 Nov 16 00:30:44.676254 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 124/263] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:44 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:30:44.677314 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-a3dee6cc-e980-4b84-8cc8-470424e8aa54 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:44.680579 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-a3dee6cc-e980-4b84-8cc8-470424e8aa54 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:44.687147 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a39a38c7-0125-47cd-ae25-57ace022572d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:44.689560 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a39a38c7-0125-47cd-ae25-57ace022572d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:44.702254 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a39a38c7-0125-47cd-ae25-57ace022572d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:44.706743 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a39a38c7-0125-47cd-ae25-57ace022572d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:44.708492 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a3dee6cc-e980-4b84-8cc8-470424e8aa54 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:44.709247 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a39a38c7-0125-47cd-ae25-57ace022572d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:44.709404 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a3dee6cc-e980-4b84-8cc8-470424e8aa54 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:44.710794 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a3dee6cc-e980-4b84-8cc8-470424e8aa54 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:44.710981 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a39a38c7-0125-47cd-ae25-57ace022572d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:44.712004 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a3dee6cc-e980-4b84-8cc8-470424e8aa54 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:44.838176 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a39a38c7-0125-47cd-ae25-57ace022572d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 35237 microversion: 2.1 time: 0.158862 Nov 16 00:30:44.845279 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 125/264] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:44 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 35237 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:30:44.872372 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-02ba059a-792e-4c0a-b028-5ae0ccfcf085 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:44.874818 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-02ba059a-792e-4c0a-b028-5ae0ccfcf085 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:44.890325 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-02ba059a-792e-4c0a-b028-5ae0ccfcf085 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:44.891969 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-02ba059a-792e-4c0a-b028-5ae0ccfcf085 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:44.893412 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-02ba059a-792e-4c0a-b028-5ae0ccfcf085 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:44.894432 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-02ba059a-792e-4c0a-b028-5ae0ccfcf085 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:44.973603 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-a3dee6cc-e980-4b84-8cc8-470424e8aa54 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:44.988007 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-a3dee6cc-e980-4b84-8cc8-470424e8aa54 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1266 microversion: 2.1 time: 0.338244 Nov 16 00:30:44.988540 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 140/265] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:44 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:45.039731 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-02ba059a-792e-4c0a-b028-5ae0ccfcf085 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 36121 microversion: 2.20 time: 0.175293 Nov 16 00:30:45.045688 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 126/266] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:44 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 36121 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:30:45.684372 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-57e28f9a-ec50-42c9-a43d-4b6da9cba6d6 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:45.684995 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-57e28f9a-ec50-42c9-a43d-4b6da9cba6d6 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:45.693328 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-57e28f9a-ec50-42c9-a43d-4b6da9cba6d6 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:45.694023 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-57e28f9a-ec50-42c9-a43d-4b6da9cba6d6 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:45.695027 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-57e28f9a-ec50-42c9-a43d-4b6da9cba6d6 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:45.695585 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-57e28f9a-ec50-42c9-a43d-4b6da9cba6d6 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:45.854535 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-53ef0c73-052b-4cf2-842c-bca604053ffc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:45.856333 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-53ef0c73-052b-4cf2-842c-bca604053ffc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:45.869820 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-53ef0c73-052b-4cf2-842c-bca604053ffc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:45.870676 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-53ef0c73-052b-4cf2-842c-bca604053ffc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:45.872353 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-53ef0c73-052b-4cf2-842c-bca604053ffc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:45.873094 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-53ef0c73-052b-4cf2-842c-bca604053ffc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:45.972309 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-57e28f9a-ec50-42c9-a43d-4b6da9cba6d6 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:45.982554 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-57e28f9a-ec50-42c9-a43d-4b6da9cba6d6 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.301832 Nov 16 00:30:45.983954 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 141/267] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:45 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:45.989432 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-53ef0c73-052b-4cf2-842c-bca604053ffc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 36024 microversion: 2.1 time: 0.139717 Nov 16 00:30:45.990776 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 127/268] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:45 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 36024 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:30:46.013316 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-cd7fd13b-f75c-4d10-b5dc-1514c8165c57 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:46.014349 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-cd7fd13b-f75c-4d10-b5dc-1514c8165c57 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:46.021293 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cd7fd13b-f75c-4d10-b5dc-1514c8165c57 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:46.022149 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cd7fd13b-f75c-4d10-b5dc-1514c8165c57 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:46.023094 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cd7fd13b-f75c-4d10-b5dc-1514c8165c57 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:46.023838 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cd7fd13b-f75c-4d10-b5dc-1514c8165c57 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:46.057356 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-7622b340-5224-49e9-a58e-14ee0a1a51c1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:46.059009 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-7622b340-5224-49e9-a58e-14ee0a1a51c1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:46.069411 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7622b340-5224-49e9-a58e-14ee0a1a51c1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:46.070252 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7622b340-5224-49e9-a58e-14ee0a1a51c1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:46.072733 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7622b340-5224-49e9-a58e-14ee0a1a51c1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:46.073496 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7622b340-5224-49e9-a58e-14ee0a1a51c1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:46.299719 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-cd7fd13b-f75c-4d10-b5dc-1514c8165c57 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:46.319106 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-cd7fd13b-f75c-4d10-b5dc-1514c8165c57 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1266 microversion: 2.1 time: 0.309092 Nov 16 00:30:46.320547 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 142/269] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:46 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1266 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:46.369891 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-7622b340-5224-49e9-a58e-14ee0a1a51c1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 37030 microversion: 2.20 time: 0.317982 Nov 16 00:30:46.371187 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 128/270] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:46 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 37030 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:30:47.003195 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-3fa3824c-1eba-4acd-95b4-4d495f4eb39e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:47.005424 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-3fa3824c-1eba-4acd-95b4-4d495f4eb39e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:47.013599 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3fa3824c-1eba-4acd-95b4-4d495f4eb39e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:47.014318 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3fa3824c-1eba-4acd-95b4-4d495f4eb39e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:47.014570 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-dfe8a8b2-c0b7-4810-847d-9805402056c4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:47.015720 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3fa3824c-1eba-4acd-95b4-4d495f4eb39e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:47.016089 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-dfe8a8b2-c0b7-4810-847d-9805402056c4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:47.016468 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3fa3824c-1eba-4acd-95b4-4d495f4eb39e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:47.027431 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dfe8a8b2-c0b7-4810-847d-9805402056c4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:47.028202 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dfe8a8b2-c0b7-4810-847d-9805402056c4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:47.029726 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dfe8a8b2-c0b7-4810-847d-9805402056c4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:47.030454 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dfe8a8b2-c0b7-4810-847d-9805402056c4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:47.215603 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-dfe8a8b2-c0b7-4810-847d-9805402056c4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:47.226868 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-dfe8a8b2-c0b7-4810-847d-9805402056c4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.219468 Nov 16 00:30:47.227651 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 129/271] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:47 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:47.348516 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-ed6f50d1-b095-4677-8dd1-c93924711c8f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:47.349187 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-ed6f50d1-b095-4677-8dd1-c93924711c8f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:47.356452 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ed6f50d1-b095-4677-8dd1-c93924711c8f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:47.356949 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ed6f50d1-b095-4677-8dd1-c93924711c8f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:47.357798 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ed6f50d1-b095-4677-8dd1-c93924711c8f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:47.358322 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ed6f50d1-b095-4677-8dd1-c93924711c8f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:47.518182 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-ed6f50d1-b095-4677-8dd1-c93924711c8f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:47.531964 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-ed6f50d1-b095-4677-8dd1-c93924711c8f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1266 microversion: 2.1 time: 0.186399 Nov 16 00:30:47.533310 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 130/272] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:47 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:30:47.543660 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-58cb631a-583d-489f-b92c-64427c7d7597 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:47.545297 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-58cb631a-583d-489f-b92c-64427c7d7597 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:47.554443 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-58cb631a-583d-489f-b92c-64427c7d7597 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:47.554875 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-58cb631a-583d-489f-b92c-64427c7d7597 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:47.555700 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-58cb631a-583d-489f-b92c-64427c7d7597 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:47.556128 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-58cb631a-583d-489f-b92c-64427c7d7597 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:49.659348 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-3fa3824c-1eba-4acd-95b4-4d495f4eb39e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 38255 microversion: 2.1 time: 2.660411 Nov 16 00:30:49.660012 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 143/273] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:46 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 38255 bytes in 2662 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:30:49.665257 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-2ba16295-140f-40a3-a8de-0ab830f977a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:49.665939 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-2ba16295-140f-40a3-a8de-0ab830f977a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:49.673183 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2ba16295-140f-40a3-a8de-0ab830f977a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:49.673595 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2ba16295-140f-40a3-a8de-0ab830f977a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:49.674431 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2ba16295-140f-40a3-a8de-0ab830f977a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:49.674868 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2ba16295-140f-40a3-a8de-0ab830f977a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:49.682698 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-58cb631a-583d-489f-b92c-64427c7d7597 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 38208 microversion: 2.20 time: 2.147008 Nov 16 00:30:49.684285 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 131/274] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:47 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 38208 bytes in 2150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:30:49.695295 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-4b54b8e5-7589-4df1-8286-52dceba90d45 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:49.696585 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-4b54b8e5-7589-4df1-8286-52dceba90d45 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:49.711109 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4b54b8e5-7589-4df1-8286-52dceba90d45 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:49.712056 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4b54b8e5-7589-4df1-8286-52dceba90d45 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:49.713898 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4b54b8e5-7589-4df1-8286-52dceba90d45 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:49.714977 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4b54b8e5-7589-4df1-8286-52dceba90d45 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:49.870204 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2ba16295-140f-40a3-a8de-0ab830f977a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:49.879028 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-2ba16295-140f-40a3-a8de-0ab830f977a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.217599 Nov 16 00:30:49.880068 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 144/275] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:49 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:49.935942 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-4b54b8e5-7589-4df1-8286-52dceba90d45 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:49.958969 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-4b54b8e5-7589-4df1-8286-52dceba90d45 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1266 microversion: 2.1 time: 0.272362 Nov 16 00:30:49.960654 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 132/276] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:49 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:50.675082 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c95bf4b0-f4b9-4321-8bcd-e35010c115f5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:50.676989 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c95bf4b0-f4b9-4321-8bcd-e35010c115f5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:50.685302 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c95bf4b0-f4b9-4321-8bcd-e35010c115f5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:50.688613 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c95bf4b0-f4b9-4321-8bcd-e35010c115f5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:50.691851 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c95bf4b0-f4b9-4321-8bcd-e35010c115f5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:50.692703 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c95bf4b0-f4b9-4321-8bcd-e35010c115f5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:50.705142 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-b0d385af-d66b-43d2-9e02-89f42198e72f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:50.713064 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-b0d385af-d66b-43d2-9e02-89f42198e72f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:50.726560 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b0d385af-d66b-43d2-9e02-89f42198e72f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:50.727402 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b0d385af-d66b-43d2-9e02-89f42198e72f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:50.728867 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b0d385af-d66b-43d2-9e02-89f42198e72f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:50.729667 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b0d385af-d66b-43d2-9e02-89f42198e72f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:50.815514 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c95bf4b0-f4b9-4321-8bcd-e35010c115f5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 38260 microversion: 2.1 time: 0.145836 Nov 16 00:30:50.816176 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 145/277] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:50 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 38260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:30:50.860892 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-b0d385af-d66b-43d2-9e02-89f42198e72f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 38214 microversion: 2.20 time: 0.165133 Nov 16 00:30:50.861434 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 133/278] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:50 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 38214 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:30:50.899790 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-31cf3a51-60b5-4ccb-83a9-a6bd60c38010 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:50.901207 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-31cf3a51-60b5-4ccb-83a9-a6bd60c38010 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:50.910971 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-31cf3a51-60b5-4ccb-83a9-a6bd60c38010 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:50.911673 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-31cf3a51-60b5-4ccb-83a9-a6bd60c38010 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:50.912833 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-31cf3a51-60b5-4ccb-83a9-a6bd60c38010 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:50.919580 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-31cf3a51-60b5-4ccb-83a9-a6bd60c38010 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:50.993343 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-aafb152e-cb43-410b-a2d9-150d492d1d6d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:50.993343 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-aafb152e-cb43-410b-a2d9-150d492d1d6d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:51.004959 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-aafb152e-cb43-410b-a2d9-150d492d1d6d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:51.006038 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-aafb152e-cb43-410b-a2d9-150d492d1d6d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:51.007539 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-aafb152e-cb43-410b-a2d9-150d492d1d6d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:51.008498 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-aafb152e-cb43-410b-a2d9-150d492d1d6d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:51.121542 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-31cf3a51-60b5-4ccb-83a9-a6bd60c38010 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:51.133059 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-31cf3a51-60b5-4ccb-83a9-a6bd60c38010 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1500 microversion: 2.1 time: 0.238384 Nov 16 00:30:51.139712 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 146/279] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:50 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1500 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:30:51.158505 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-cfb0873b-92fd-4b28-b5b6-09e74ebbcf81 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82668e72-2619-43b0-bc57-cf568b15480d"}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:51.159884 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-cfb0873b-92fd-4b28-b5b6-09e74ebbcf81 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:51.169330 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cfb0873b-92fd-4b28-b5b6-09e74ebbcf81 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:51.170202 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cfb0873b-92fd-4b28-b5b6-09e74ebbcf81 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:51.171492 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cfb0873b-92fd-4b28-b5b6-09e74ebbcf81 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:51.172280 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cfb0873b-92fd-4b28-b5b6-09e74ebbcf81 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:51.215025 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-cfb0873b-92fd-4b28-b5b6-09e74ebbcf81 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] HTTP exception thrown: Cannot 'attach_volume' instance 896600e3-829b-43f9-87af-60d271f05432 while it is in vm_state rescued Nov 16 00:30:51.216279 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-cfb0873b-92fd-4b28-b5b6-09e74ebbcf81 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Returning 409 to user: Cannot 'attach_volume' instance 896600e3-829b-43f9-87af-60d271f05432 while it is in vm_state rescued {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:30:51.217499 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-cfb0873b-92fd-4b28-b5b6-09e74ebbcf81 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "POST /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.064662 Nov 16 00:30:51.218285 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 147/280] 10.222.0.31 () {60 vars in 1322 bytes} [Tue Nov 16 00:30:51 2021] POST /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432/os-volume_attachments => generated 152 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 16 00:30:51.231402 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-52afa69e-aeba-45bf-ba6a-bb19dd240094 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:51.231619 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-52afa69e-aeba-45bf-ba6a-bb19dd240094 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:51.242226 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-52afa69e-aeba-45bf-ba6a-bb19dd240094 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:51.242967 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-52afa69e-aeba-45bf-ba6a-bb19dd240094 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:51.245186 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-52afa69e-aeba-45bf-ba6a-bb19dd240094 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:51.245899 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-52afa69e-aeba-45bf-ba6a-bb19dd240094 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:51.255778 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-aafb152e-cb43-410b-a2d9-150d492d1d6d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:51.265036 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-aafb152e-cb43-410b-a2d9-150d492d1d6d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1266 microversion: 2.1 time: 0.284208 Nov 16 00:30:51.273273 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 134/281] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:50 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:51.358246 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-52afa69e-aeba-45bf-ba6a-bb19dd240094 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "POST /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432/action" status: 202 len: 0 microversion: 2.1 time: 0.132849 Nov 16 00:30:51.363833 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 148/282] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:51 2021] POST /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:30:51.369598 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a341e2f7-5245-4d6a-83ad-7af29bcec351 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:51.370426 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a341e2f7-5245-4d6a-83ad-7af29bcec351 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:51.380031 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a341e2f7-5245-4d6a-83ad-7af29bcec351 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:51.381129 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a341e2f7-5245-4d6a-83ad-7af29bcec351 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:51.382315 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a341e2f7-5245-4d6a-83ad-7af29bcec351 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:51.382856 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a341e2f7-5245-4d6a-83ad-7af29bcec351 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:51.622603 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a341e2f7-5245-4d6a-83ad-7af29bcec351 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:51.634059 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a341e2f7-5245-4d6a-83ad-7af29bcec351 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1508 microversion: 2.1 time: 0.268486 Nov 16 00:30:51.634914 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 135/283] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:51 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1508 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:51.835364 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-9f6bfbd8-c4fa-49fa-8ab7-5e07814b03f4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:51.838406 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-9f6bfbd8-c4fa-49fa-8ab7-5e07814b03f4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:51.852525 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9f6bfbd8-c4fa-49fa-8ab7-5e07814b03f4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:51.853586 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9f6bfbd8-c4fa-49fa-8ab7-5e07814b03f4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:51.855334 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9f6bfbd8-c4fa-49fa-8ab7-5e07814b03f4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:51.856423 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9f6bfbd8-c4fa-49fa-8ab7-5e07814b03f4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:51.879921 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e4e4f3cd-0f5f-42b2-91d8-5ee6572f1fc8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:51.882502 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e4e4f3cd-0f5f-42b2-91d8-5ee6572f1fc8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:51.894964 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e4e4f3cd-0f5f-42b2-91d8-5ee6572f1fc8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:51.896277 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e4e4f3cd-0f5f-42b2-91d8-5ee6572f1fc8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:51.897922 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e4e4f3cd-0f5f-42b2-91d8-5ee6572f1fc8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:51.899230 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e4e4f3cd-0f5f-42b2-91d8-5ee6572f1fc8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:51.984156 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-9f6bfbd8-c4fa-49fa-8ab7-5e07814b03f4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 200 len: 38386 microversion: 2.1 time: 0.156719 Nov 16 00:30:51.985976 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 149/284] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:30:51 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 38386 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:30:52.016278 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c95d678d-f33d-43f0-8f5a-77cfc546e363 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:52.018176 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c95d678d-f33d-43f0-8f5a-77cfc546e363 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:52.033583 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c95d678d-f33d-43f0-8f5a-77cfc546e363 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:52.034736 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c95d678d-f33d-43f0-8f5a-77cfc546e363 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:52.037089 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c95d678d-f33d-43f0-8f5a-77cfc546e363 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:52.038322 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c95d678d-f33d-43f0-8f5a-77cfc546e363 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:52.048150 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e4e4f3cd-0f5f-42b2-91d8-5ee6572f1fc8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 200 len: 38349 microversion: 2.20 time: 0.174529 Nov 16 00:30:52.049365 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 136/285] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:51 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 38349 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:30:52.066084 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-217a882a-ee50-4183-86fb-893ec5169075 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:52.066843 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-217a882a-ee50-4183-86fb-893ec5169075 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:52.078212 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-217a882a-ee50-4183-86fb-893ec5169075 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:52.079477 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-217a882a-ee50-4183-86fb-893ec5169075 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:52.080441 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-217a882a-ee50-4183-86fb-893ec5169075 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:52.081253 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-217a882a-ee50-4183-86fb-893ec5169075 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:52.116094 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-217a882a-ee50-4183-86fb-893ec5169075 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/ips" status: 200 len: 151 microversion: 2.20 time: 0.054861 Nov 16 00:30:52.117242 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 137/286] 10.222.0.31 () {60 vars in 1288 bytes} [Tue Nov 16 00:30:52 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/ips => generated 151 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:30:52.137012 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c95d678d-f33d-43f0-8f5a-77cfc546e363 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/ips" status: 200 len: 146 microversion: 2.1 time: 0.137626 Nov 16 00:30:52.139650 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 150/287] 10.222.0.31 () {58 vars in 1247 bytes} [Tue Nov 16 00:30:51 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/ips => generated 146 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:30:52.287312 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-193926ae-080d-4efb-bd36-c12b69baa2ee tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:52.288433 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-193926ae-080d-4efb-bd36-c12b69baa2ee tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:52.310596 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-193926ae-080d-4efb-bd36-c12b69baa2ee tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:52.313667 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-193926ae-080d-4efb-bd36-c12b69baa2ee tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:52.316181 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-193926ae-080d-4efb-bd36-c12b69baa2ee tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:52.318546 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-193926ae-080d-4efb-bd36-c12b69baa2ee tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:52.641674 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-193926ae-080d-4efb-bd36-c12b69baa2ee tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:52.658506 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-193926ae-080d-4efb-bd36-c12b69baa2ee tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1266 microversion: 2.1 time: 0.378505 Nov 16 00:30:52.663106 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1fc3f7f4-0635-4aa7-886c-032d07450df9 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:52.666063 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1fc3f7f4-0635-4aa7-886c-032d07450df9 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:52.676612 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 138/288] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:52 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1266 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:52.694864 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1fc3f7f4-0635-4aa7-886c-032d07450df9 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:52.696689 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1fc3f7f4-0635-4aa7-886c-032d07450df9 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:52.699753 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1fc3f7f4-0635-4aa7-886c-032d07450df9 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:52.700999 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1fc3f7f4-0635-4aa7-886c-032d07450df9 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:52.952461 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-1fc3f7f4-0635-4aa7-886c-032d07450df9 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:52.964454 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-1fc3f7f4-0635-4aa7-886c-032d07450df9 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1508 microversion: 2.1 time: 0.310127 Nov 16 00:30:52.965513 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 151/289] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:52 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1508 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:53.694527 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-446969c9-85e9-4c87-98d8-c21b15411c5d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:53.695642 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-446969c9-85e9-4c87-98d8-c21b15411c5d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:53.732297 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-446969c9-85e9-4c87-98d8-c21b15411c5d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:53.735424 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-446969c9-85e9-4c87-98d8-c21b15411c5d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:53.737937 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-446969c9-85e9-4c87-98d8-c21b15411c5d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:53.739085 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-446969c9-85e9-4c87-98d8-c21b15411c5d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:53.990620 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-48fe4583-6f93-4c4a-b582-fc44252df2fe tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:53.991811 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-48fe4583-6f93-4c4a-b582-fc44252df2fe tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:54.032473 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-48fe4583-6f93-4c4a-b582-fc44252df2fe tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:54.032473 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-48fe4583-6f93-4c4a-b582-fc44252df2fe tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:54.034132 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-48fe4583-6f93-4c4a-b582-fc44252df2fe tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:54.036819 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-48fe4583-6f93-4c4a-b582-fc44252df2fe tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:54.090402 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-446969c9-85e9-4c87-98d8-c21b15411c5d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:54.120347 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-446969c9-85e9-4c87-98d8-c21b15411c5d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1266 microversion: 2.1 time: 0.434930 Nov 16 00:30:54.126908 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 139/290] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:53 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1266 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:30:54.306605 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-48fe4583-6f93-4c4a-b582-fc44252df2fe tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:54.315893 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-48fe4583-6f93-4c4a-b582-fc44252df2fe tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1508 microversion: 2.1 time: 0.333602 Nov 16 00:30:54.316590 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 152/291] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:53 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1508 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:54.857071 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-378016ec-d283-4e79-b187-bf63141f6938 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:54.858939 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-378016ec-d283-4e79-b187-bf63141f6938 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:54.869007 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-378016ec-d283-4e79-b187-bf63141f6938 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:54.869640 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-378016ec-d283-4e79-b187-bf63141f6938 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:54.870777 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-378016ec-d283-4e79-b187-bf63141f6938 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:54.871463 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-378016ec-d283-4e79-b187-bf63141f6938 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:54.913163 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.objects.instance [None req-378016ec-d283-4e79-b187-bf63141f6938 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lazy-loading 'flavor' on Instance uuid 3f9b823f-75c2-4baf-9577-5dc85ec77405 {{(pid=122544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:30:55.143802 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-e35ab746-52ec-4087-8679-f52b5f56e26b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:55.144617 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-e35ab746-52ec-4087-8679-f52b5f56e26b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:55.161158 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e35ab746-52ec-4087-8679-f52b5f56e26b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:55.165713 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e35ab746-52ec-4087-8679-f52b5f56e26b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:55.170384 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e35ab746-52ec-4087-8679-f52b5f56e26b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:55.175707 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e35ab746-52ec-4087-8679-f52b5f56e26b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:55.545771 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e35ab746-52ec-4087-8679-f52b5f56e26b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:55.566183 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-e35ab746-52ec-4087-8679-f52b5f56e26b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1266 microversion: 2.1 time: 0.425756 Nov 16 00:30:55.579331 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 153/292] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:55 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1266 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:30:55.594060 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-abba1761-ce21-4782-bb44-2e5d3b125b25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "787a13fd-05d7-4c8c-bbe6-c7e8d0a3710f"}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:55.603825 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-abba1761-ce21-4782-bb44-2e5d3b125b25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:55.608507 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-378016ec-d283-4e79-b187-bf63141f6938 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 202 len: 0 microversion: 2.20 time: 0.773958 Nov 16 00:30:55.610733 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 140/293] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:30:54 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 0 bytes in 778 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 16 00:30:55.621681 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-6e29c021-3a93-41f5-8981-a0dbc381f60f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:55.624005 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-6e29c021-3a93-41f5-8981-a0dbc381f60f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:55.643724 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6e29c021-3a93-41f5-8981-a0dbc381f60f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:55.645036 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6e29c021-3a93-41f5-8981-a0dbc381f60f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:55.647789 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6e29c021-3a93-41f5-8981-a0dbc381f60f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:55.649212 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6e29c021-3a93-41f5-8981-a0dbc381f60f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:55.660921 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-abba1761-ce21-4782-bb44-2e5d3b125b25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:55.665485 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-abba1761-ce21-4782-bb44-2e5d3b125b25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:55.668540 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-abba1761-ce21-4782-bb44-2e5d3b125b25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:55.669527 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-abba1761-ce21-4782-bb44-2e5d3b125b25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:55.949400 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-6e29c021-3a93-41f5-8981-a0dbc381f60f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:55.959378 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-6e29c021-3a93-41f5-8981-a0dbc381f60f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1514 microversion: 2.1 time: 0.346344 Nov 16 00:30:55.959978 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 141/294] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:55 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1514 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:55.969627 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-af746ed1-c4e3-428c-b7c3-113c755959d9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:55.972168 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-af746ed1-c4e3-428c-b7c3-113c755959d9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:55.994322 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-af746ed1-c4e3-428c-b7c3-113c755959d9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:55.995240 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-af746ed1-c4e3-428c-b7c3-113c755959d9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:55.996872 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-af746ed1-c4e3-428c-b7c3-113c755959d9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:55.998149 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-af746ed1-c4e3-428c-b7c3-113c755959d9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:56.305762 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-af746ed1-c4e3-428c-b7c3-113c755959d9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:56.329758 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-af746ed1-c4e3-428c-b7c3-113c755959d9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:56.333537 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-af746ed1-c4e3-428c-b7c3-113c755959d9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:56.336424 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-af746ed1-c4e3-428c-b7c3-113c755959d9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1721 microversion: 2.20 time: 0.370882 Nov 16 00:30:56.337897 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 142/295] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:30:55 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1721 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:30:56.381092 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-13f5b95b-d03c-4a8e-8885-39a215a518ef req-76948764-1acc-41f5-b2c9-17ad4acd0c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e", "name": "network-vif-plugged", "status": "completed", "tag": "1a9e347e-ccd8-44e3-b595-51e076101a93"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:56.384864 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:30:56.384864 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:30:56.398394 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-abba1761-ce21-4782-bb44-2e5d3b125b25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.812643 Nov 16 00:30:56.401714 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 154/296] 10.222.0.31 () {60 vars in 1322 bytes} [Tue Nov 16 00:30:55 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/os-volume_attachments => generated 194 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:30:56.407021 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-13f5b95b-d03c-4a8e-8885-39a215a518ef req-76948764-1acc-41f5-b2c9-17ad4acd0c7e service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:56.412205 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-13f5b95b-d03c-4a8e-8885-39a215a518ef req-76948764-1acc-41f5-b2c9-17ad4acd0c7e service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:56.465340 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-13f5b95b-d03c-4a8e-8885-39a215a518ef req-76948764-1acc-41f5-b2c9-17ad4acd0c7e service nova] Creating event network-vif-plugged:1a9e347e-ccd8-44e3-b595-51e076101a93 for instance e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e on hv-cinder-81115 Nov 16 00:30:56.478738 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-13f5b95b-d03c-4a8e-8885-39a215a518ef req-76948764-1acc-41f5-b2c9-17ad4acd0c7e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111799 Nov 16 00:30:56.491696 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 143/297] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:30:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:30:56.610698 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ff3a54d1-e98a-46e6-9f2f-1f01996faf6d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:56.659726 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ff3a54d1-e98a-46e6-9f2f-1f01996faf6d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:56.697883 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ff3a54d1-e98a-46e6-9f2f-1f01996faf6d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:56.700429 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ff3a54d1-e98a-46e6-9f2f-1f01996faf6d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:56.705135 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ff3a54d1-e98a-46e6-9f2f-1f01996faf6d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:56.707257 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ff3a54d1-e98a-46e6-9f2f-1f01996faf6d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:57.371426 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-96d4eb26-d466-402a-b734-e01bd0d221f5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:57.372835 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-96d4eb26-d466-402a-b734-e01bd0d221f5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:57.381490 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-96d4eb26-d466-402a-b734-e01bd0d221f5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:57.381818 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-96d4eb26-d466-402a-b734-e01bd0d221f5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:57.382654 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-96d4eb26-d466-402a-b734-e01bd0d221f5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:57.383310 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-96d4eb26-d466-402a-b734-e01bd0d221f5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:57.393473 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-ff3a54d1-e98a-46e6-9f2f-1f01996faf6d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:57.420681 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ff3a54d1-e98a-46e6-9f2f-1f01996faf6d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1266 microversion: 2.1 time: 0.819907 Nov 16 00:30:57.424051 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 155/298] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:56 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1266 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:57.654136 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-96d4eb26-d466-402a-b734-e01bd0d221f5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:57.664221 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-96d4eb26-d466-402a-b734-e01bd0d221f5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:57.665936 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-96d4eb26-d466-402a-b734-e01bd0d221f5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:57.667236 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-96d4eb26-d466-402a-b734-e01bd0d221f5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1721 microversion: 2.20 time: 0.300168 Nov 16 00:30:57.667823 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 144/299] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:30:57 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1721 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:30:58.119443 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-2658aa4e-1e8b-4a50-baf3-b588d78a5439 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:58.121439 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-2658aa4e-1e8b-4a50-baf3-b588d78a5439 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:58.133353 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2658aa4e-1e8b-4a50-baf3-b588d78a5439 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:58.134450 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2658aa4e-1e8b-4a50-baf3-b588d78a5439 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:58.136229 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2658aa4e-1e8b-4a50-baf3-b588d78a5439 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:58.137130 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2658aa4e-1e8b-4a50-baf3-b588d78a5439 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:58.444059 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-c949634e-f289-45fb-82b9-c9c9198e9f76 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:58.446174 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-c949634e-f289-45fb-82b9-c9c9198e9f76 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:58.466579 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c949634e-f289-45fb-82b9-c9c9198e9f76 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:58.467835 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c949634e-f289-45fb-82b9-c9c9198e9f76 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:58.470054 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c949634e-f289-45fb-82b9-c9c9198e9f76 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:58.471130 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c949634e-f289-45fb-82b9-c9c9198e9f76 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:58.540090 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2658aa4e-1e8b-4a50-baf3-b588d78a5439 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:58.555351 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-2658aa4e-1e8b-4a50-baf3-b588d78a5439 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1514 microversion: 2.1 time: 0.443833 Nov 16 00:30:58.569407 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 156/300] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:58 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1514 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:30:58.583377 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-62707809-baeb-4abd-8a84-80ec1b3804ce tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a7c049b-a455-4d52-a3d5-d00dd6d196a3"}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:30:58.590782 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-62707809-baeb-4abd-8a84-80ec1b3804ce tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:58.606905 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-62707809-baeb-4abd-8a84-80ec1b3804ce tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:58.607543 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-62707809-baeb-4abd-8a84-80ec1b3804ce tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:58.608541 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-62707809-baeb-4abd-8a84-80ec1b3804ce tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:58.611740 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-62707809-baeb-4abd-8a84-80ec1b3804ce tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:59.034347 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-c949634e-f289-45fb-82b9-c9c9198e9f76 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:59.059804 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-c949634e-f289-45fb-82b9-c9c9198e9f76 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1266 microversion: 2.1 time: 0.619082 Nov 16 00:30:59.064024 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 145/301] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:30:58 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1266 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:30:59.079442 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-5438e301-d8ed-42e5-a1e7-991052067f9d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:30:59.080991 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-5438e301-d8ed-42e5-a1e7-991052067f9d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:30:59.097960 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5438e301-d8ed-42e5-a1e7-991052067f9d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:59.099494 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5438e301-d8ed-42e5-a1e7-991052067f9d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:59.101086 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5438e301-d8ed-42e5-a1e7-991052067f9d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:30:59.101988 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5438e301-d8ed-42e5-a1e7-991052067f9d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:30:59.325225 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-62707809-baeb-4abd-8a84-80ec1b3804ce tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "POST /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.747385 Nov 16 00:30:59.325977 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 157/302] 10.222.0.31 () {60 vars in 1322 bytes} [Tue Nov 16 00:30:58 2021] POST /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432/os-volume_attachments => generated 194 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:30:59.341597 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-5438e301-d8ed-42e5-a1e7-991052067f9d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:59.355092 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-5438e301-d8ed-42e5-a1e7-991052067f9d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:59.356774 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-5438e301-d8ed-42e5-a1e7-991052067f9d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:30:59.358081 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-5438e301-d8ed-42e5-a1e7-991052067f9d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1721 microversion: 2.20 time: 0.291177 Nov 16 00:30:59.358848 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 146/303] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:30:59 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1721 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:00.082322 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-a2af5c6f-88a1-4b22-9100-375c133b8c67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:00.083105 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-a2af5c6f-88a1-4b22-9100-375c133b8c67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:00.095802 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a2af5c6f-88a1-4b22-9100-375c133b8c67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:00.097736 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a2af5c6f-88a1-4b22-9100-375c133b8c67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:00.098610 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a2af5c6f-88a1-4b22-9100-375c133b8c67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:00.099075 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a2af5c6f-88a1-4b22-9100-375c133b8c67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:00.384408 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-5c160c5a-d558-40f5-aa38-753f4ea5bf08 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:00.387234 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-5c160c5a-d558-40f5-aa38-753f4ea5bf08 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:00.399572 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5c160c5a-d558-40f5-aa38-753f4ea5bf08 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:00.400421 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5c160c5a-d558-40f5-aa38-753f4ea5bf08 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:00.401978 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5c160c5a-d558-40f5-aa38-753f4ea5bf08 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:00.402999 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5c160c5a-d558-40f5-aa38-753f4ea5bf08 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:00.624599 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-a2af5c6f-88a1-4b22-9100-375c133b8c67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:00.641834 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-a2af5c6f-88a1-4b22-9100-375c133b8c67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1453 microversion: 2.1 time: 0.563478 Nov 16 00:31:00.644051 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 158/304] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:00 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1453 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:00.672788 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-d29589e9-cedf-4104-8867-1cb1055b3ab9 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:00.673515 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-5c160c5a-d558-40f5-aa38-753f4ea5bf08 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:00.673751 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d29589e9-cedf-4104-8867-1cb1055b3ab9 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:00.688351 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d29589e9-cedf-4104-8867-1cb1055b3ab9 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:00.689568 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d29589e9-cedf-4104-8867-1cb1055b3ab9 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:00.689753 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-5c160c5a-d558-40f5-aa38-753f4ea5bf08 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:00.691942 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d29589e9-cedf-4104-8867-1cb1055b3ab9 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:00.692955 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-5c160c5a-d558-40f5-aa38-753f4ea5bf08 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:00.693583 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d29589e9-cedf-4104-8867-1cb1055b3ab9 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:00.696048 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-5c160c5a-d558-40f5-aa38-753f4ea5bf08 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1721 microversion: 2.20 time: 0.317869 Nov 16 00:31:00.697028 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 147/305] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:00 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1721 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:31:01.042058 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-d29589e9-cedf-4104-8867-1cb1055b3ab9 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:01.068596 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-d29589e9-cedf-4104-8867-1cb1055b3ab9 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1453 microversion: 2.1 time: 0.399157 Nov 16 00:31:01.071004 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 159/306] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:00 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1453 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:01.733463 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d4ef178a-8539-4f59-9e10-f39a63795981 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:01.740558 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d4ef178a-8539-4f59-9e10-f39a63795981 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:01.769825 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d4ef178a-8539-4f59-9e10-f39a63795981 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:01.769825 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d4ef178a-8539-4f59-9e10-f39a63795981 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:01.770707 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d4ef178a-8539-4f59-9e10-f39a63795981 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:01.771504 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d4ef178a-8539-4f59-9e10-f39a63795981 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:02.418703 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d4ef178a-8539-4f59-9e10-f39a63795981 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:02.441630 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d4ef178a-8539-4f59-9e10-f39a63795981 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:02.445360 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d4ef178a-8539-4f59-9e10-f39a63795981 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:02.447947 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d4ef178a-8539-4f59-9e10-f39a63795981 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1721 microversion: 2.20 time: 0.723331 Nov 16 00:31:02.449478 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 148/307] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:01 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1721 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:03.475775 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-d4a8608d-6555-4bb9-91ec-92fa7828832e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:03.476463 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d4a8608d-6555-4bb9-91ec-92fa7828832e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:03.483183 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d4a8608d-6555-4bb9-91ec-92fa7828832e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:03.490092 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d4a8608d-6555-4bb9-91ec-92fa7828832e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:03.491253 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d4a8608d-6555-4bb9-91ec-92fa7828832e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:03.491870 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d4a8608d-6555-4bb9-91ec-92fa7828832e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:04.212556 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-d4a8608d-6555-4bb9-91ec-92fa7828832e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:04.239905 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-d4a8608d-6555-4bb9-91ec-92fa7828832e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:04.245199 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-d4a8608d-6555-4bb9-91ec-92fa7828832e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:04.250653 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-d4a8608d-6555-4bb9-91ec-92fa7828832e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1721 microversion: 2.20 time: 0.776484 Nov 16 00:31:04.252800 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 160/308] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:03 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1721 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:04.948353 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e5b393e7-137d-435c-9718-4c43e1215f06 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:31:04.961280 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e5b393e7-137d-435c-9718-4c43e1215f06 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:04.963662 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e5b393e7-137d-435c-9718-4c43e1215f06 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:05.097895 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e5b393e7-137d-435c-9718-4c43e1215f06 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Going to try to stop instance {{(pid=122544) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Nov 16 00:31:05.177484 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e5b393e7-137d-435c-9718-4c43e1215f06 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 202 len: 0 microversion: 2.1 time: 0.237528 Nov 16 00:31:05.179652 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 149/309] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:31:04 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:31:05.194373 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-3cb445d5-8889-4fe1-9d82-036ab2f596a7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:05.195560 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-3cb445d5-8889-4fe1-9d82-036ab2f596a7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:05.225915 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3cb445d5-8889-4fe1-9d82-036ab2f596a7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:05.238367 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3cb445d5-8889-4fe1-9d82-036ab2f596a7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:05.241215 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3cb445d5-8889-4fe1-9d82-036ab2f596a7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:05.251566 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3cb445d5-8889-4fe1-9d82-036ab2f596a7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:05.290746 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-b43fab1b-c193-4d08-a14b-f4b8a7ce5f81 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:05.291774 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-b43fab1b-c193-4d08-a14b-f4b8a7ce5f81 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:05.304422 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b43fab1b-c193-4d08-a14b-f4b8a7ce5f81 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:05.304869 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b43fab1b-c193-4d08-a14b-f4b8a7ce5f81 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:05.305681 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b43fab1b-c193-4d08-a14b-f4b8a7ce5f81 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:05.306116 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b43fab1b-c193-4d08-a14b-f4b8a7ce5f81 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:05.746828 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-b43fab1b-c193-4d08-a14b-f4b8a7ce5f81 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:05.763164 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-b43fab1b-c193-4d08-a14b-f4b8a7ce5f81 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:05.765911 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-b43fab1b-c193-4d08-a14b-f4b8a7ce5f81 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:05.768783 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-b43fab1b-c193-4d08-a14b-f4b8a7ce5f81 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1721 microversion: 2.20 time: 0.483316 Nov 16 00:31:05.773032 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 150/310] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:05 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1721 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:31:05.905765 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-3cb445d5-8889-4fe1-9d82-036ab2f596a7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:05.936992 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-3cb445d5-8889-4fe1-9d82-036ab2f596a7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1723 microversion: 2.1 time: 0.749734 Nov 16 00:31:05.947366 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 161/311] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:05 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1723 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:06.798813 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a707295d-a9e6-4d84-a143-d9327e6d0501 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:06.800039 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a707295d-a9e6-4d84-a143-d9327e6d0501 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:06.818366 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a707295d-a9e6-4d84-a143-d9327e6d0501 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:06.821978 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a707295d-a9e6-4d84-a143-d9327e6d0501 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:06.823209 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a707295d-a9e6-4d84-a143-d9327e6d0501 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:06.828448 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a707295d-a9e6-4d84-a143-d9327e6d0501 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:06.970225 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-12bedd4c-0c2b-4ef1-abd4-ebf28a2b0ef6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:06.971084 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-12bedd4c-0c2b-4ef1-abd4-ebf28a2b0ef6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:06.981815 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-12bedd4c-0c2b-4ef1-abd4-ebf28a2b0ef6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:06.982323 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-12bedd4c-0c2b-4ef1-abd4-ebf28a2b0ef6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:06.983950 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-12bedd4c-0c2b-4ef1-abd4-ebf28a2b0ef6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:06.995434 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-12bedd4c-0c2b-4ef1-abd4-ebf28a2b0ef6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:07.242519 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a707295d-a9e6-4d84-a143-d9327e6d0501 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:07.318237 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a707295d-a9e6-4d84-a143-d9327e6d0501 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:07.342627 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a707295d-a9e6-4d84-a143-d9327e6d0501 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:07.359010 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a707295d-a9e6-4d84-a143-d9327e6d0501 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1721 microversion: 2.20 time: 0.559889 Nov 16 00:31:07.365915 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 151/312] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:06 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1721 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:31:07.396801 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-e95a0a00-da91-4756-92ce-3bd2725e6b3a req-90d8e729-0f11-4cdc-a105-0d7cac2fb3e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e", "tag": "1a9e347e-ccd8-44e3-b595-51e076101a93"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:31:07.411195 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:31:07.411195 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:31:07.438142 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-e95a0a00-da91-4756-92ce-3bd2725e6b3a req-90d8e729-0f11-4cdc-a105-0d7cac2fb3e5 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:07.438832 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-e95a0a00-da91-4756-92ce-3bd2725e6b3a req-90d8e729-0f11-4cdc-a105-0d7cac2fb3e5 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:07.446509 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-12bedd4c-0c2b-4ef1-abd4-ebf28a2b0ef6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:07.485596 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-e95a0a00-da91-4756-92ce-3bd2725e6b3a req-90d8e729-0f11-4cdc-a105-0d7cac2fb3e5 service nova] Creating event network-changed:1a9e347e-ccd8-44e3-b595-51e076101a93 for instance e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e on hv-cinder-81115 Nov 16 00:31:07.497646 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-12bedd4c-0c2b-4ef1-abd4-ebf28a2b0ef6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1723 microversion: 2.1 time: 0.529139 Nov 16 00:31:07.501640 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 162/313] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:06 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1723 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:07.518482 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-e95a0a00-da91-4756-92ce-3bd2725e6b3a req-90d8e729-0f11-4cdc-a105-0d7cac2fb3e5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150709 Nov 16 00:31:07.524128 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 152/314] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:31:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:31:08.383633 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-22022c1f-5022-4977-894f-4f1dfb742e80 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:08.384760 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-22022c1f-5022-4977-894f-4f1dfb742e80 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:08.412708 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-22022c1f-5022-4977-894f-4f1dfb742e80 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:08.414023 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-22022c1f-5022-4977-894f-4f1dfb742e80 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:08.420294 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-22022c1f-5022-4977-894f-4f1dfb742e80 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:08.421061 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-22022c1f-5022-4977-894f-4f1dfb742e80 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:08.533219 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0119ddce-c2d1-4dad-81ad-f907c26ed610 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:08.534816 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0119ddce-c2d1-4dad-81ad-f907c26ed610 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:08.557469 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0119ddce-c2d1-4dad-81ad-f907c26ed610 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:08.558297 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0119ddce-c2d1-4dad-81ad-f907c26ed610 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:08.564448 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0119ddce-c2d1-4dad-81ad-f907c26ed610 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:08.570340 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0119ddce-c2d1-4dad-81ad-f907c26ed610 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:08.916072 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0119ddce-c2d1-4dad-81ad-f907c26ed610 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:08.944501 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0119ddce-c2d1-4dad-81ad-f907c26ed610 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1723 microversion: 2.1 time: 0.419130 Nov 16 00:31:08.945701 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 153/315] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:08 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1723 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:09.033272 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-22022c1f-5022-4977-894f-4f1dfb742e80 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:09.060964 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-22022c1f-5022-4977-894f-4f1dfb742e80 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:09.069399 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-22022c1f-5022-4977-894f-4f1dfb742e80 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:09.071021 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-22022c1f-5022-4977-894f-4f1dfb742e80 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1721 microversion: 2.20 time: 0.695782 Nov 16 00:31:09.090507 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 163/316] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:08 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1721 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:09.977021 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-46103d33-84d5-4e98-9ca7-eb29fd65f14f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:09.978255 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-46103d33-84d5-4e98-9ca7-eb29fd65f14f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:09.988347 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-46103d33-84d5-4e98-9ca7-eb29fd65f14f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:09.989035 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-46103d33-84d5-4e98-9ca7-eb29fd65f14f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:09.990561 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-46103d33-84d5-4e98-9ca7-eb29fd65f14f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:09.991606 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-46103d33-84d5-4e98-9ca7-eb29fd65f14f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:10.098625 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-00efe1f6-b6f6-43cf-a268-1f1bc651c70d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:10.099457 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-00efe1f6-b6f6-43cf-a268-1f1bc651c70d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:10.109910 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-00efe1f6-b6f6-43cf-a268-1f1bc651c70d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:10.110354 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-00efe1f6-b6f6-43cf-a268-1f1bc651c70d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:10.115197 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-00efe1f6-b6f6-43cf-a268-1f1bc651c70d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:10.115902 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-00efe1f6-b6f6-43cf-a268-1f1bc651c70d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:10.634259 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-46103d33-84d5-4e98-9ca7-eb29fd65f14f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:10.653754 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-46103d33-84d5-4e98-9ca7-eb29fd65f14f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1723 microversion: 2.1 time: 0.680863 Nov 16 00:31:10.668278 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 154/317] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:09 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1723 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:10.780585 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-00efe1f6-b6f6-43cf-a268-1f1bc651c70d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:10.800818 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-00efe1f6-b6f6-43cf-a268-1f1bc651c70d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:10.804184 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-00efe1f6-b6f6-43cf-a268-1f1bc651c70d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:10.805994 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-00efe1f6-b6f6-43cf-a268-1f1bc651c70d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1721 microversion: 2.20 time: 0.711126 Nov 16 00:31:10.809584 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 164/318] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:10 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1721 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:31:11.698655 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-5ec41df2-daa5-45be-9079-543b59be3b99 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:11.705805 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-5ec41df2-daa5-45be-9079-543b59be3b99 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:11.717599 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5ec41df2-daa5-45be-9079-543b59be3b99 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:11.718047 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5ec41df2-daa5-45be-9079-543b59be3b99 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:11.719782 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5ec41df2-daa5-45be-9079-543b59be3b99 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:11.720233 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5ec41df2-daa5-45be-9079-543b59be3b99 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:11.824412 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-06bc15c8-f30d-4d1f-a733-c75aacac7564 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:11.825755 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-06bc15c8-f30d-4d1f-a733-c75aacac7564 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:11.835021 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-06bc15c8-f30d-4d1f-a733-c75aacac7564 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:11.835919 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-06bc15c8-f30d-4d1f-a733-c75aacac7564 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:11.837460 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-06bc15c8-f30d-4d1f-a733-c75aacac7564 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:11.838098 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-06bc15c8-f30d-4d1f-a733-c75aacac7564 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:11.879091 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-5ec41df2-daa5-45be-9079-543b59be3b99 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:11.889641 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-5ec41df2-daa5-45be-9079-543b59be3b99 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1723 microversion: 2.1 time: 0.207411 Nov 16 00:31:11.890773 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 155/319] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:11 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:12.477147 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-2f575c14-c725-4818-a62b-55a514a20ac3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:31:12.478536 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-2f575c14-c725-4818-a62b-55a514a20ac3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:12.486280 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2f575c14-c725-4818-a62b-55a514a20ac3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:12.486576 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2f575c14-c725-4818-a62b-55a514a20ac3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:12.487434 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2f575c14-c725-4818-a62b-55a514a20ac3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:12.488048 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2f575c14-c725-4818-a62b-55a514a20ac3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:12.514006 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-06bc15c8-f30d-4d1f-a733-c75aacac7564 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:12.519916 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.objects.instance [None req-2f575c14-c725-4818-a62b-55a514a20ac3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lazy-loading 'flavor' on Instance uuid 896600e3-829b-43f9-87af-60d271f05432 {{(pid=122544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:31:12.532426 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-06bc15c8-f30d-4d1f-a733-c75aacac7564 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:12.534987 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-06bc15c8-f30d-4d1f-a733-c75aacac7564 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:12.538034 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-06bc15c8-f30d-4d1f-a733-c75aacac7564 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1721 microversion: 2.20 time: 0.717642 Nov 16 00:31:12.539348 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 165/320] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:11 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1721 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:12.797820 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-2f575c14-c725-4818-a62b-55a514a20ac3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "POST /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432/action" status: 200 len: 32 microversion: 2.1 time: 0.324423 Nov 16 00:31:12.798741 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 156/321] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:31:12 2021] POST /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432/action => generated 32 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 16 00:31:12.807692 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-b0791e86-b90d-4178-93db-9671301cce5b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:12.808900 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b0791e86-b90d-4178-93db-9671301cce5b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:12.817548 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b0791e86-b90d-4178-93db-9671301cce5b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:12.818460 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b0791e86-b90d-4178-93db-9671301cce5b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:12.820469 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b0791e86-b90d-4178-93db-9671301cce5b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:12.821611 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b0791e86-b90d-4178-93db-9671301cce5b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:12.915035 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-75b0e165-f2f5-47de-b20e-192172945d99 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:12.916493 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-75b0e165-f2f5-47de-b20e-192172945d99 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:12.943446 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-75b0e165-f2f5-47de-b20e-192172945d99 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:12.944228 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-75b0e165-f2f5-47de-b20e-192172945d99 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:12.945884 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-75b0e165-f2f5-47de-b20e-192172945d99 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:12.946919 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-75b0e165-f2f5-47de-b20e-192172945d99 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:13.188159 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-b0791e86-b90d-4178-93db-9671301cce5b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:13.197490 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-b0791e86-b90d-4178-93db-9671301cce5b tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1566 microversion: 2.1 time: 0.393654 Nov 16 00:31:13.198101 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 166/322] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:12 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1566 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:13.240968 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-75b0e165-f2f5-47de-b20e-192172945d99 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:13.255754 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-75b0e165-f2f5-47de-b20e-192172945d99 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1723 microversion: 2.1 time: 0.349633 Nov 16 00:31:13.257345 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 157/323] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:12 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1723 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:13.574147 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f5acf485-d3b7-43fa-8a16-94d6f8b453d8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:13.574837 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f5acf485-d3b7-43fa-8a16-94d6f8b453d8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:13.589998 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f5acf485-d3b7-43fa-8a16-94d6f8b453d8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:13.594555 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f5acf485-d3b7-43fa-8a16-94d6f8b453d8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:13.596241 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f5acf485-d3b7-43fa-8a16-94d6f8b453d8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:13.598522 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f5acf485-d3b7-43fa-8a16-94d6f8b453d8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:13.986967 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f5acf485-d3b7-43fa-8a16-94d6f8b453d8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:13.996498 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f5acf485-d3b7-43fa-8a16-94d6f8b453d8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:13.998604 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f5acf485-d3b7-43fa-8a16-94d6f8b453d8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:14.000177 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f5acf485-d3b7-43fa-8a16-94d6f8b453d8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1721 microversion: 2.20 time: 0.431142 Nov 16 00:31:14.011814 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 167/324] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:13 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1721 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:31:14.221408 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-bcd56863-e955-4cd5-95a0-2b8808a17750 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:14.225148 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-bcd56863-e955-4cd5-95a0-2b8808a17750 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:14.242082 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bcd56863-e955-4cd5-95a0-2b8808a17750 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:14.243692 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bcd56863-e955-4cd5-95a0-2b8808a17750 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:14.246315 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bcd56863-e955-4cd5-95a0-2b8808a17750 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:14.248217 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bcd56863-e955-4cd5-95a0-2b8808a17750 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:14.276665 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-36856a10-2fde-4d40-90d7-f11a4e1af2fb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:14.278446 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-36856a10-2fde-4d40-90d7-f11a4e1af2fb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:14.292432 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-36856a10-2fde-4d40-90d7-f11a4e1af2fb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:14.294111 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-36856a10-2fde-4d40-90d7-f11a4e1af2fb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:14.299847 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-36856a10-2fde-4d40-90d7-f11a4e1af2fb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:14.300312 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-36856a10-2fde-4d40-90d7-f11a4e1af2fb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:14.528967 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-36856a10-2fde-4d40-90d7-f11a4e1af2fb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:14.568516 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-36856a10-2fde-4d40-90d7-f11a4e1af2fb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1723 microversion: 2.1 time: 0.297021 Nov 16 00:31:14.574558 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 168/325] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:14 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:14.656959 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-bcd56863-e955-4cd5-95a0-2b8808a17750 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:14.673552 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-bcd56863-e955-4cd5-95a0-2b8808a17750 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1566 microversion: 2.1 time: 0.460016 Nov 16 00:31:14.674632 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 158/326] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:14 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1566 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:15.027410 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-6ed24ea1-2dae-444d-a726-3dc9d371bb11 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:15.028627 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-6ed24ea1-2dae-444d-a726-3dc9d371bb11 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:15.054200 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6ed24ea1-2dae-444d-a726-3dc9d371bb11 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:15.055909 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6ed24ea1-2dae-444d-a726-3dc9d371bb11 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:15.057492 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6ed24ea1-2dae-444d-a726-3dc9d371bb11 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:15.058782 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6ed24ea1-2dae-444d-a726-3dc9d371bb11 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:15.314374 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-6ed24ea1-2dae-444d-a726-3dc9d371bb11 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:15.331735 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-6ed24ea1-2dae-444d-a726-3dc9d371bb11 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:15.336959 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-6ed24ea1-2dae-444d-a726-3dc9d371bb11 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:15.339422 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-6ed24ea1-2dae-444d-a726-3dc9d371bb11 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1721 microversion: 2.20 time: 0.322713 Nov 16 00:31:15.340447 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 169/327] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:15 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1721 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:15.599594 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-7b843c73-b0be-4fcb-a543-ea5b79b63414 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:15.600511 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-7b843c73-b0be-4fcb-a543-ea5b79b63414 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:15.608936 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7b843c73-b0be-4fcb-a543-ea5b79b63414 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:15.609745 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7b843c73-b0be-4fcb-a543-ea5b79b63414 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:15.611197 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7b843c73-b0be-4fcb-a543-ea5b79b63414 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:15.611842 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7b843c73-b0be-4fcb-a543-ea5b79b63414 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:15.695209 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-325e6801-1922-4c94-9b9f-edfacc832666 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:15.696351 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-325e6801-1922-4c94-9b9f-edfacc832666 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:15.706809 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-325e6801-1922-4c94-9b9f-edfacc832666 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:15.708292 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-325e6801-1922-4c94-9b9f-edfacc832666 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:15.709758 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-325e6801-1922-4c94-9b9f-edfacc832666 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:15.710599 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-325e6801-1922-4c94-9b9f-edfacc832666 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:15.940045 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-325e6801-1922-4c94-9b9f-edfacc832666 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:15.956283 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-7b843c73-b0be-4fcb-a543-ea5b79b63414 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:15.959020 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-325e6801-1922-4c94-9b9f-edfacc832666 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1566 microversion: 2.1 time: 0.270382 Nov 16 00:31:15.959986 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 170/328] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:15 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1566 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:15.973878 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-7b843c73-b0be-4fcb-a543-ea5b79b63414 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1723 microversion: 2.1 time: 0.378265 Nov 16 00:31:15.976349 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 159/329] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:15 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1723 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:16.367899 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-24811321-5e62-489a-a5e1-982156d43711 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:16.368943 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-24811321-5e62-489a-a5e1-982156d43711 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:16.377387 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-24811321-5e62-489a-a5e1-982156d43711 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:16.378023 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-24811321-5e62-489a-a5e1-982156d43711 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:16.378934 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-24811321-5e62-489a-a5e1-982156d43711 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:16.379490 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-24811321-5e62-489a-a5e1-982156d43711 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:16.566740 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-24811321-5e62-489a-a5e1-982156d43711 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:16.575726 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-24811321-5e62-489a-a5e1-982156d43711 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:16.577650 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-24811321-5e62-489a-a5e1-982156d43711 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:16.579137 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-24811321-5e62-489a-a5e1-982156d43711 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1721 microversion: 2.20 time: 0.216497 Nov 16 00:31:16.579910 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 171/330] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:16 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:16.981849 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-c8a682ce-25c8-44be-925d-a9d9772c2cec tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:16.983247 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-c8a682ce-25c8-44be-925d-a9d9772c2cec tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:16.994147 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c8a682ce-25c8-44be-925d-a9d9772c2cec tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:16.995558 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c8a682ce-25c8-44be-925d-a9d9772c2cec tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:16.999017 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c8a682ce-25c8-44be-925d-a9d9772c2cec tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:17.000148 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c8a682ce-25c8-44be-925d-a9d9772c2cec tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:17.003111 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-25142726-e756-4f83-b949-911d12916ef3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:17.004185 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-25142726-e756-4f83-b949-911d12916ef3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:17.022805 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-25142726-e756-4f83-b949-911d12916ef3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:17.023469 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-25142726-e756-4f83-b949-911d12916ef3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:17.024406 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-25142726-e756-4f83-b949-911d12916ef3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:17.024957 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-25142726-e756-4f83-b949-911d12916ef3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:17.302783 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-c8a682ce-25c8-44be-925d-a9d9772c2cec tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:17.316893 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-c8a682ce-25c8-44be-925d-a9d9772c2cec tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1566 microversion: 2.1 time: 0.340326 Nov 16 00:31:17.319997 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 160/331] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:16 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1566 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:17.362194 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-25142726-e756-4f83-b949-911d12916ef3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:17.378330 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-25142726-e756-4f83-b949-911d12916ef3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1723 microversion: 2.1 time: 0.381394 Nov 16 00:31:17.380752 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 172/332] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:16 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1723 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:17.607987 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-8e9ad9a9-3be9-4819-bb2c-187bcae40639 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:17.610005 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-8e9ad9a9-3be9-4819-bb2c-187bcae40639 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:17.623439 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8e9ad9a9-3be9-4819-bb2c-187bcae40639 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:17.632215 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8e9ad9a9-3be9-4819-bb2c-187bcae40639 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:17.634176 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8e9ad9a9-3be9-4819-bb2c-187bcae40639 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:17.638881 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8e9ad9a9-3be9-4819-bb2c-187bcae40639 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:17.946960 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-8e9ad9a9-3be9-4819-bb2c-187bcae40639 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:17.973663 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-8e9ad9a9-3be9-4819-bb2c-187bcae40639 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:17.978163 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-8e9ad9a9-3be9-4819-bb2c-187bcae40639 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:17.982684 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-8e9ad9a9-3be9-4819-bb2c-187bcae40639 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1721 microversion: 2.20 time: 0.385147 Nov 16 00:31:17.984650 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 161/333] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:17 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1721 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:18.350828 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1f8e7b81-7aa2-486c-b8f2-b2bed95065a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:18.352045 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1f8e7b81-7aa2-486c-b8f2-b2bed95065a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:18.369135 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1f8e7b81-7aa2-486c-b8f2-b2bed95065a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:18.371082 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1f8e7b81-7aa2-486c-b8f2-b2bed95065a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:18.385516 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1f8e7b81-7aa2-486c-b8f2-b2bed95065a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:18.401570 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1f8e7b81-7aa2-486c-b8f2-b2bed95065a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:18.407713 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-ddf6174f-132d-44e0-b4bd-ca06aac3060e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:18.408848 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-ddf6174f-132d-44e0-b4bd-ca06aac3060e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:18.431758 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ddf6174f-132d-44e0-b4bd-ca06aac3060e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:18.436020 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ddf6174f-132d-44e0-b4bd-ca06aac3060e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:18.438806 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ddf6174f-132d-44e0-b4bd-ca06aac3060e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:18.442374 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ddf6174f-132d-44e0-b4bd-ca06aac3060e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:18.778842 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-ddf6174f-132d-44e0-b4bd-ca06aac3060e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:18.799532 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-ddf6174f-132d-44e0-b4bd-ca06aac3060e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1723 microversion: 2.1 time: 0.397058 Nov 16 00:31:18.816410 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 162/334] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:18 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1723 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:18.865393 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-1f8e7b81-7aa2-486c-b8f2-b2bed95065a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:18.886325 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-1f8e7b81-7aa2-486c-b8f2-b2bed95065a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1566 microversion: 2.1 time: 0.544176 Nov 16 00:31:18.889936 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 173/335] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:18 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1566 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:19.013536 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-df996fdf-b745-4ec8-96b7-113ecaccc83c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:19.015161 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-df996fdf-b745-4ec8-96b7-113ecaccc83c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:19.023957 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-df996fdf-b745-4ec8-96b7-113ecaccc83c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:19.024851 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-df996fdf-b745-4ec8-96b7-113ecaccc83c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:19.026751 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-df996fdf-b745-4ec8-96b7-113ecaccc83c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:19.027673 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-df996fdf-b745-4ec8-96b7-113ecaccc83c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:19.349512 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-df996fdf-b745-4ec8-96b7-113ecaccc83c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:19.372631 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-df996fdf-b745-4ec8-96b7-113ecaccc83c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:19.376397 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-df996fdf-b745-4ec8-96b7-113ecaccc83c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:19.379001 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-df996fdf-b745-4ec8-96b7-113ecaccc83c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1742 microversion: 2.20 time: 0.369726 Nov 16 00:31:19.380533 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 163/336] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:19 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1742 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:19.833445 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-26a0f4a1-25a2-46e5-aa5b-30260cabe80f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:19.834643 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-26a0f4a1-25a2-46e5-aa5b-30260cabe80f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:19.846847 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-26a0f4a1-25a2-46e5-aa5b-30260cabe80f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:19.847687 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-26a0f4a1-25a2-46e5-aa5b-30260cabe80f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:19.849104 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-26a0f4a1-25a2-46e5-aa5b-30260cabe80f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:19.851735 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-26a0f4a1-25a2-46e5-aa5b-30260cabe80f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:19.915777 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d91239ae-9050-4433-9592-9e45b6d09c95 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:19.916275 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d91239ae-9050-4433-9592-9e45b6d09c95 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:19.932862 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d91239ae-9050-4433-9592-9e45b6d09c95 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:19.933657 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d91239ae-9050-4433-9592-9e45b6d09c95 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:19.934667 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d91239ae-9050-4433-9592-9e45b6d09c95 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:19.935373 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d91239ae-9050-4433-9592-9e45b6d09c95 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:20.189953 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d91239ae-9050-4433-9592-9e45b6d09c95 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:20.204794 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d91239ae-9050-4433-9592-9e45b6d09c95 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1566 microversion: 2.1 time: 0.292938 Nov 16 00:31:20.216032 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 164/337] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:19 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1566 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:20.239794 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-26a0f4a1-25a2-46e5-aa5b-30260cabe80f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:20.256918 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-26a0f4a1-25a2-46e5-aa5b-30260cabe80f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1723 microversion: 2.1 time: 0.430920 Nov 16 00:31:20.257954 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 174/338] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:19 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1723 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:20.425483 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-ba56535f-dd3b-49f4-96d2-0c27ae4b2bcc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:20.426819 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-ba56535f-dd3b-49f4-96d2-0c27ae4b2bcc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:20.442493 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ba56535f-dd3b-49f4-96d2-0c27ae4b2bcc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:20.444247 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ba56535f-dd3b-49f4-96d2-0c27ae4b2bcc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:20.446067 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ba56535f-dd3b-49f4-96d2-0c27ae4b2bcc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:20.448462 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ba56535f-dd3b-49f4-96d2-0c27ae4b2bcc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:20.712034 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-ba56535f-dd3b-49f4-96d2-0c27ae4b2bcc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:20.738371 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-ba56535f-dd3b-49f4-96d2-0c27ae4b2bcc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:20.740394 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-ba56535f-dd3b-49f4-96d2-0c27ae4b2bcc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:20.745487 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-ba56535f-dd3b-49f4-96d2-0c27ae4b2bcc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1742 microversion: 2.20 time: 0.337009 Nov 16 00:31:20.745813 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 165/339] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:20 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1742 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:21.228591 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-523080a7-5b85-45c5-8731-4111be3e2c09 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:21.237147 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-523080a7-5b85-45c5-8731-4111be3e2c09 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:21.256776 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-523080a7-5b85-45c5-8731-4111be3e2c09 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:21.273300 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-523080a7-5b85-45c5-8731-4111be3e2c09 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:21.275593 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-523080a7-5b85-45c5-8731-4111be3e2c09 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:21.277971 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-523080a7-5b85-45c5-8731-4111be3e2c09 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:21.282363 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-5ee6a08d-c0bb-4086-adf5-1fab53b4ad15 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:21.283408 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-5ee6a08d-c0bb-4086-adf5-1fab53b4ad15 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:21.313728 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5ee6a08d-c0bb-4086-adf5-1fab53b4ad15 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:21.321469 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5ee6a08d-c0bb-4086-adf5-1fab53b4ad15 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:21.323298 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5ee6a08d-c0bb-4086-adf5-1fab53b4ad15 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:21.334543 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5ee6a08d-c0bb-4086-adf5-1fab53b4ad15 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:21.697913 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-523080a7-5b85-45c5-8731-4111be3e2c09 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:21.712410 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-523080a7-5b85-45c5-8731-4111be3e2c09 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1566 microversion: 2.1 time: 0.493059 Nov 16 00:31:21.727411 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 175/340] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:21 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1566 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:21.782139 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-e00d56fd-c994-4e27-8109-e53a07cba054 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:21.782775 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-e00d56fd-c994-4e27-8109-e53a07cba054 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:21.796618 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e00d56fd-c994-4e27-8109-e53a07cba054 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:21.801692 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e00d56fd-c994-4e27-8109-e53a07cba054 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:21.802555 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e00d56fd-c994-4e27-8109-e53a07cba054 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:21.802999 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e00d56fd-c994-4e27-8109-e53a07cba054 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:21.906899 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-5ee6a08d-c0bb-4086-adf5-1fab53b4ad15 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:21.945046 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-5ee6a08d-c0bb-4086-adf5-1fab53b4ad15 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1723 microversion: 2.1 time: 0.671935 Nov 16 00:31:21.946963 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 166/341] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:21 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1723 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:22.116908 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e00d56fd-c994-4e27-8109-e53a07cba054 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:22.159898 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e00d56fd-c994-4e27-8109-e53a07cba054 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:22.162932 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e00d56fd-c994-4e27-8109-e53a07cba054 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:22.172837 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-e00d56fd-c994-4e27-8109-e53a07cba054 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1737 microversion: 2.20 time: 0.390809 Nov 16 00:31:22.181676 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 176/342] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:21 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1737 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:31:22.738702 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-03ebe139-dea5-4065-a14e-3a1dbc07a896 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:22.740972 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-03ebe139-dea5-4065-a14e-3a1dbc07a896 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:22.762529 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-03ebe139-dea5-4065-a14e-3a1dbc07a896 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:22.767831 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-03ebe139-dea5-4065-a14e-3a1dbc07a896 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:22.770117 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-03ebe139-dea5-4065-a14e-3a1dbc07a896 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:22.771435 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-03ebe139-dea5-4065-a14e-3a1dbc07a896 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:22.970820 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-405aeec8-18ef-477e-97ce-91da902ee4f5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:22.974940 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-405aeec8-18ef-477e-97ce-91da902ee4f5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:22.996161 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-405aeec8-18ef-477e-97ce-91da902ee4f5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:22.996980 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-405aeec8-18ef-477e-97ce-91da902ee4f5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:22.998045 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-405aeec8-18ef-477e-97ce-91da902ee4f5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:22.998701 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-405aeec8-18ef-477e-97ce-91da902ee4f5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:23.243480 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-03ebe139-dea5-4065-a14e-3a1dbc07a896 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:23.278749 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-03ebe139-dea5-4065-a14e-3a1dbc07a896 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1566 microversion: 2.1 time: 0.547692 Nov 16 00:31:23.299621 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 167/343] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:22 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1566 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:23.305394 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-05358817-4e11-4a63-be0c-13f28ab0e362 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:23.306333 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-05358817-4e11-4a63-be0c-13f28ab0e362 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:23.314497 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-05358817-4e11-4a63-be0c-13f28ab0e362 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:23.314928 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-05358817-4e11-4a63-be0c-13f28ab0e362 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:23.315927 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-05358817-4e11-4a63-be0c-13f28ab0e362 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:23.316534 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-05358817-4e11-4a63-be0c-13f28ab0e362 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:23.381708 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-405aeec8-18ef-477e-97ce-91da902ee4f5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:23.392436 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-405aeec8-18ef-477e-97ce-91da902ee4f5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1723 microversion: 2.1 time: 0.428646 Nov 16 00:31:23.396251 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 177/344] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:22 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1723 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:23.602793 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-05358817-4e11-4a63-be0c-13f28ab0e362 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:23.616658 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-05358817-4e11-4a63-be0c-13f28ab0e362 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:23.619214 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-05358817-4e11-4a63-be0c-13f28ab0e362 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:23.620829 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-05358817-4e11-4a63-be0c-13f28ab0e362 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1737 microversion: 2.20 time: 0.319691 Nov 16 00:31:23.633430 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 168/345] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:23 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1737 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:23.967600 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-7914e337-49bd-40b4-9956-4406285c2bb1 req-75e75d49-247f-4a51-8a67-a86c4ff41a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f9b823f-75c2-4baf-9577-5dc85ec77405", "name": "network-vif-plugged", "status": "completed", "tag": "10abc4a6-a723-4a5c-855b-11d4b6d40eb9"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:31:23.975940 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:31:23.975940 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:31:23.985818 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-7914e337-49bd-40b4-9956-4406285c2bb1 req-75e75d49-247f-4a51-8a67-a86c4ff41a7a service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:23.986419 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-7914e337-49bd-40b4-9956-4406285c2bb1 req-75e75d49-247f-4a51-8a67-a86c4ff41a7a service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:24.002205 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-7914e337-49bd-40b4-9956-4406285c2bb1 req-75e75d49-247f-4a51-8a67-a86c4ff41a7a service nova] Creating event network-vif-plugged:10abc4a6-a723-4a5c-855b-11d4b6d40eb9 for instance 3f9b823f-75c2-4baf-9577-5dc85ec77405 on hv-cinder-81115 Nov 16 00:31:24.008581 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-7914e337-49bd-40b4-9956-4406285c2bb1 req-75e75d49-247f-4a51-8a67-a86c4ff41a7a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048316 Nov 16 00:31:24.009584 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 178/346] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:31:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:31:24.306773 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-9c851271-9157-4d8b-8a14-d8c5b4dfa781 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:24.307681 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-9c851271-9157-4d8b-8a14-d8c5b4dfa781 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:24.318740 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9c851271-9157-4d8b-8a14-d8c5b4dfa781 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:24.319976 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9c851271-9157-4d8b-8a14-d8c5b4dfa781 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:24.321653 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9c851271-9157-4d8b-8a14-d8c5b4dfa781 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:24.322667 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9c851271-9157-4d8b-8a14-d8c5b4dfa781 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:24.415878 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8e67da60-11da-4723-9c24-39cf37123a86 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:24.416855 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8e67da60-11da-4723-9c24-39cf37123a86 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:24.433728 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8e67da60-11da-4723-9c24-39cf37123a86 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:24.434466 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8e67da60-11da-4723-9c24-39cf37123a86 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:24.435540 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8e67da60-11da-4723-9c24-39cf37123a86 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:24.436113 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8e67da60-11da-4723-9c24-39cf37123a86 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:24.806003 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-9c851271-9157-4d8b-8a14-d8c5b4dfa781 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:24.834251 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-9c851271-9157-4d8b-8a14-d8c5b4dfa781 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1566 microversion: 2.1 time: 0.531055 Nov 16 00:31:24.842308 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 169/347] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:24 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1566 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:24.866237 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-8f973e5a-e199-45a5-80ca-b123810fb3fa tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:24.867788 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-8f973e5a-e199-45a5-80ca-b123810fb3fa tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:24.883305 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8f973e5a-e199-45a5-80ca-b123810fb3fa tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:24.884457 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8f973e5a-e199-45a5-80ca-b123810fb3fa tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:24.886180 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8f973e5a-e199-45a5-80ca-b123810fb3fa tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:24.887295 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8f973e5a-e199-45a5-80ca-b123810fb3fa tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:25.277394 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-8f973e5a-e199-45a5-80ca-b123810fb3fa tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:25.311179 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-8e67da60-11da-4723-9c24-39cf37123a86 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:25.325912 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-8f973e5a-e199-45a5-80ca-b123810fb3fa tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:25.338406 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-8f973e5a-e199-45a5-80ca-b123810fb3fa tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:25.345698 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-8f973e5a-e199-45a5-80ca-b123810fb3fa tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1737 microversion: 2.20 time: 0.498389 Nov 16 00:31:25.349269 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8e67da60-11da-4723-9c24-39cf37123a86 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1700 microversion: 2.1 time: 0.938136 Nov 16 00:31:25.350668 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 179/348] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:24 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1700 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:25.368831 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 170/349] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:24 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1737 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:25.384265 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-b317aa32-222e-4227-aafd-f85a16cbf5c7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:31:25.410165 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b317aa32-222e-4227-aafd-f85a16cbf5c7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:25.411401 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b317aa32-222e-4227-aafd-f85a16cbf5c7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:25.596925 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b317aa32-222e-4227-aafd-f85a16cbf5c7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Going to try to start instance {{(pid=122543) start /opt/stack/nova/nova/compute/api.py:2675}} Nov 16 00:31:25.678543 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-b317aa32-222e-4227-aafd-f85a16cbf5c7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 202 len: 0 microversion: 2.1 time: 0.305182 Nov 16 00:31:25.678543 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 180/350] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:31:25 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:31:25.693580 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-19c1228a-cf12-4f59-910d-ff289c659492 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:25.694748 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-19c1228a-cf12-4f59-910d-ff289c659492 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:25.702982 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-19c1228a-cf12-4f59-910d-ff289c659492 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:25.703399 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-19c1228a-cf12-4f59-910d-ff289c659492 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:25.704358 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-19c1228a-cf12-4f59-910d-ff289c659492 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:25.704692 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-19c1228a-cf12-4f59-910d-ff289c659492 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:25.873722 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-61176083-9500-4d0d-87ef-c5c20f337400 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:25.874932 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-61176083-9500-4d0d-87ef-c5c20f337400 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:25.896947 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-61176083-9500-4d0d-87ef-c5c20f337400 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:25.897399 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-61176083-9500-4d0d-87ef-c5c20f337400 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:25.898233 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-61176083-9500-4d0d-87ef-c5c20f337400 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:25.898697 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-61176083-9500-4d0d-87ef-c5c20f337400 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:26.028820 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-19c1228a-cf12-4f59-910d-ff289c659492 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:26.053843 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-19c1228a-cf12-4f59-910d-ff289c659492 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1709 microversion: 2.1 time: 0.367445 Nov 16 00:31:26.082300 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 171/351] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:25 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1709 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:26.381363 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3cde6d07-f2ee-4d9d-9d24-2c71df8e973b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:26.383788 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3cde6d07-f2ee-4d9d-9d24-2c71df8e973b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:26.420723 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3cde6d07-f2ee-4d9d-9d24-2c71df8e973b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:26.426637 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3cde6d07-f2ee-4d9d-9d24-2c71df8e973b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:26.428410 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3cde6d07-f2ee-4d9d-9d24-2c71df8e973b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:26.429418 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3cde6d07-f2ee-4d9d-9d24-2c71df8e973b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:26.807514 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3cde6d07-f2ee-4d9d-9d24-2c71df8e973b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:26.834601 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3cde6d07-f2ee-4d9d-9d24-2c71df8e973b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:26.838630 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3cde6d07-f2ee-4d9d-9d24-2c71df8e973b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:26.843272 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-3cde6d07-f2ee-4d9d-9d24-2c71df8e973b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1737 microversion: 2.20 time: 0.469006 Nov 16 00:31:26.851130 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-61176083-9500-4d0d-87ef-c5c20f337400 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:26.852938 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 172/352] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:26 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1737 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:26.864716 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-61176083-9500-4d0d-87ef-c5c20f337400 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1566 microversion: 2.1 time: 1.000742 Nov 16 00:31:26.867601 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 181/353] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:25 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1566 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:27.089121 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f9b6921d-ffab-4370-ba56-74ca0443d351 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:27.090087 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f9b6921d-ffab-4370-ba56-74ca0443d351 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:27.101103 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f9b6921d-ffab-4370-ba56-74ca0443d351 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:27.123021 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f9b6921d-ffab-4370-ba56-74ca0443d351 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:27.123021 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f9b6921d-ffab-4370-ba56-74ca0443d351 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:27.123021 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f9b6921d-ffab-4370-ba56-74ca0443d351 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:27.450527 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-f9b6921d-ffab-4370-ba56-74ca0443d351 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:27.505856 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-f9b6921d-ffab-4370-ba56-74ca0443d351 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1709 microversion: 2.1 time: 0.421060 Nov 16 00:31:27.523099 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 173/354] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:27 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1709 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:27.876368 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-61def9ce-7397-4d5f-8062-3f9d7bebc42e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:27.877249 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-61def9ce-7397-4d5f-8062-3f9d7bebc42e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:27.906082 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-5a3d05ff-967a-4980-80ca-444dc0e4123f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:27.908346 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-5a3d05ff-967a-4980-80ca-444dc0e4123f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:27.908588 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-61def9ce-7397-4d5f-8062-3f9d7bebc42e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:27.909065 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-61def9ce-7397-4d5f-8062-3f9d7bebc42e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:27.910320 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-61def9ce-7397-4d5f-8062-3f9d7bebc42e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:27.910802 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-61def9ce-7397-4d5f-8062-3f9d7bebc42e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:27.964973 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5a3d05ff-967a-4980-80ca-444dc0e4123f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:27.971644 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5a3d05ff-967a-4980-80ca-444dc0e4123f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:27.975235 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5a3d05ff-967a-4980-80ca-444dc0e4123f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:27.976935 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5a3d05ff-967a-4980-80ca-444dc0e4123f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:28.256341 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-61def9ce-7397-4d5f-8062-3f9d7bebc42e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:28.266513 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-61def9ce-7397-4d5f-8062-3f9d7bebc42e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:28.268155 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-61def9ce-7397-4d5f-8062-3f9d7bebc42e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:28.271607 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-61def9ce-7397-4d5f-8062-3f9d7bebc42e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1737 microversion: 2.20 time: 0.399015 Nov 16 00:31:28.272912 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 182/355] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:27 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1737 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:28.431519 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-5a3d05ff-967a-4980-80ca-444dc0e4123f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:28.447242 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-5a3d05ff-967a-4980-80ca-444dc0e4123f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1566 microversion: 2.1 time: 0.549182 Nov 16 00:31:28.449117 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 174/356] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:27 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1566 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:28.560721 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-4ba5b3ca-af72-444d-beb0-a8b5ab40643d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:28.562720 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-4ba5b3ca-af72-444d-beb0-a8b5ab40643d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:28.570000 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4ba5b3ca-af72-444d-beb0-a8b5ab40643d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:28.570678 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4ba5b3ca-af72-444d-beb0-a8b5ab40643d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:28.571895 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4ba5b3ca-af72-444d-beb0-a8b5ab40643d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:28.572540 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4ba5b3ca-af72-444d-beb0-a8b5ab40643d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:28.956144 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-4ba5b3ca-af72-444d-beb0-a8b5ab40643d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:28.972894 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-4ba5b3ca-af72-444d-beb0-a8b5ab40643d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1709 microversion: 2.1 time: 0.427438 Nov 16 00:31:28.974405 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 183/357] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:28 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1709 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:29.297934 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-de01742f-3f0d-46f0-b0b7-d3c42bee33f3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:29.299004 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-de01742f-3f0d-46f0-b0b7-d3c42bee33f3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:29.329518 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-de01742f-3f0d-46f0-b0b7-d3c42bee33f3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:29.330494 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-de01742f-3f0d-46f0-b0b7-d3c42bee33f3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:29.332199 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-de01742f-3f0d-46f0-b0b7-d3c42bee33f3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:29.333358 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-de01742f-3f0d-46f0-b0b7-d3c42bee33f3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:29.474664 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-0c4e60b2-15e2-4278-8cc8-ac722a999b9a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:29.480182 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-0c4e60b2-15e2-4278-8cc8-ac722a999b9a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:29.513623 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0c4e60b2-15e2-4278-8cc8-ac722a999b9a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:29.514387 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0c4e60b2-15e2-4278-8cc8-ac722a999b9a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:29.516154 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0c4e60b2-15e2-4278-8cc8-ac722a999b9a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:29.516954 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0c4e60b2-15e2-4278-8cc8-ac722a999b9a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:29.804438 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-de01742f-3f0d-46f0-b0b7-d3c42bee33f3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:29.831273 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-de01742f-3f0d-46f0-b0b7-d3c42bee33f3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:29.834480 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-de01742f-3f0d-46f0-b0b7-d3c42bee33f3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:29.841736 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-de01742f-3f0d-46f0-b0b7-d3c42bee33f3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1737 microversion: 2.20 time: 0.551143 Nov 16 00:31:29.851493 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 175/358] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:29 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1737 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:29.908866 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-0c4e60b2-15e2-4278-8cc8-ac722a999b9a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:29.927463 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-0c4e60b2-15e2-4278-8cc8-ac722a999b9a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1566 microversion: 2.1 time: 0.460009 Nov 16 00:31:29.940065 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 184/359] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:29 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1566 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:30.006981 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-ea9c4007-05f6-4e90-8eb6-db37a5829a63 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:30.008380 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-ea9c4007-05f6-4e90-8eb6-db37a5829a63 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:30.033831 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ea9c4007-05f6-4e90-8eb6-db37a5829a63 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:30.034482 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ea9c4007-05f6-4e90-8eb6-db37a5829a63 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:30.035828 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ea9c4007-05f6-4e90-8eb6-db37a5829a63 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:30.043888 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ea9c4007-05f6-4e90-8eb6-db37a5829a63 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:30.380668 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-ea9c4007-05f6-4e90-8eb6-db37a5829a63 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:30.405850 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-ea9c4007-05f6-4e90-8eb6-db37a5829a63 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1713 microversion: 2.1 time: 0.396371 Nov 16 00:31:30.432687 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 176/360] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:29 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1713 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:30.865400 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1ef3d4d7-fd72-46e0-9ea5-4f2c4781ea0b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:30.866278 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1ef3d4d7-fd72-46e0-9ea5-4f2c4781ea0b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:30.888843 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1ef3d4d7-fd72-46e0-9ea5-4f2c4781ea0b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:30.890117 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1ef3d4d7-fd72-46e0-9ea5-4f2c4781ea0b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:30.891422 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1ef3d4d7-fd72-46e0-9ea5-4f2c4781ea0b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:30.892124 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1ef3d4d7-fd72-46e0-9ea5-4f2c4781ea0b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:30.963510 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-4c95f179-261e-48ed-99f6-46e62d1f6d6c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:30.964842 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-4c95f179-261e-48ed-99f6-46e62d1f6d6c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:30.998911 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4c95f179-261e-48ed-99f6-46e62d1f6d6c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:31.000152 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4c95f179-261e-48ed-99f6-46e62d1f6d6c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:31.001718 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4c95f179-261e-48ed-99f6-46e62d1f6d6c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:31.002687 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4c95f179-261e-48ed-99f6-46e62d1f6d6c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:31.284854 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-1ef3d4d7-fd72-46e0-9ea5-4f2c4781ea0b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:31.307454 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-1ef3d4d7-fd72-46e0-9ea5-4f2c4781ea0b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:31.375382 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-1ef3d4d7-fd72-46e0-9ea5-4f2c4781ea0b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:31.381809 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-1ef3d4d7-fd72-46e0-9ea5-4f2c4781ea0b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1737 microversion: 2.20 time: 0.519321 Nov 16 00:31:31.384171 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 185/361] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:30 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1737 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:31.458433 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-4c95f179-261e-48ed-99f6-46e62d1f6d6c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:31.508027 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-4c95f179-261e-48ed-99f6-46e62d1f6d6c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1566 microversion: 2.1 time: 0.542133 Nov 16 00:31:31.509739 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 177/362] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:30 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1566 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:31.945852 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-d35a6af3-2beb-4570-b959-4a5eae450e4f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2133662944", "imageRef": "bb47ca05-3b48-4f1c-bc96-e0c5c672caba", "flavorRef": "452"}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:31:32.420544 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f5e202e3-cccb-4468-b409-913d5c9eac00 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:32.421371 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f5e202e3-cccb-4468-b409-913d5c9eac00 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:32.436059 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f5e202e3-cccb-4468-b409-913d5c9eac00 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:32.438197 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f5e202e3-cccb-4468-b409-913d5c9eac00 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:32.439308 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f5e202e3-cccb-4468-b409-913d5c9eac00 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:32.441203 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f5e202e3-cccb-4468-b409-913d5c9eac00 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:32.766325 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-f5e202e3-cccb-4468-b409-913d5c9eac00 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:32.778480 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-f5e202e3-cccb-4468-b409-913d5c9eac00 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:32.780696 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-f5e202e3-cccb-4468-b409-913d5c9eac00 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:32.782802 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-f5e202e3-cccb-4468-b409-913d5c9eac00 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1737 microversion: 2.20 time: 0.366285 Nov 16 00:31:32.784013 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 178/363] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:32 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1737 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:32.789482 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0a7f3059-f277-4530-b0db-12dd1aaabf87 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:32.790410 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0a7f3059-f277-4530-b0db-12dd1aaabf87 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:32.798487 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0a7f3059-f277-4530-b0db-12dd1aaabf87 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:32.799530 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0a7f3059-f277-4530-b0db-12dd1aaabf87 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:32.800563 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0a7f3059-f277-4530-b0db-12dd1aaabf87 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:32.801179 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0a7f3059-f277-4530-b0db-12dd1aaabf87 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:32.996158 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0a7f3059-f277-4530-b0db-12dd1aaabf87 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:33.005726 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0a7f3059-f277-4530-b0db-12dd1aaabf87 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1566 microversion: 2.1 time: 0.220366 Nov 16 00:31:33.006982 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 179/364] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:32 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1566 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:33.569768 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-67e9e4ee-5b45-4fdd-98f7-045a6d82cb32 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Action: 'create', calling method: .version_select at 0x7f2f2983c670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1457930364"}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:31:33.599039 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.network.neutron [None req-d35a6af3-2beb-4570-b959-4a5eae450e4f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] validate_networks() for None {{(pid=122543) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:31:33.605601 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-67e9e4ee-5b45-4fdd-98f7-045a6d82cb32 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Getting quotas for project 7d4495714639486cad8d6a4039009581. Resources: {'key_pairs'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:31:33.612080 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-67e9e4ee-5b45-4fdd-98f7-045a6d82cb32 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Getting quotas for user 7f1b83dddb4a4bf5bac2ae8804a59f1f and project 7d4495714639486cad8d6a4039009581. Resources: {'key_pairs'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:31:34.038892 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-67e9e4ee-5b45-4fdd-98f7-045a6d82cb32 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Getting quotas for project 7d4495714639486cad8d6a4039009581. Resources: {'key_pairs'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:31:34.045234 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-67e9e4ee-5b45-4fdd-98f7-045a6d82cb32 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Getting quotas for user 7f1b83dddb4a4bf5bac2ae8804a59f1f and project 7d4495714639486cad8d6a4039009581. Resources: {'key_pairs'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:31:34.064328 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-67e9e4ee-5b45-4fdd-98f7-045a6d82cb32 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.497959 Nov 16 00:31:34.065642 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 180/365] 10.222.0.31 () {60 vars in 1157 bytes} [Tue Nov 16 00:31:33 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:34.070997 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a885bbee-9abe-464e-b1cc-2e6a6d5eebf0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:34.071925 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a885bbee-9abe-464e-b1cc-2e6a6d5eebf0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:34.098097 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a885bbee-9abe-464e-b1cc-2e6a6d5eebf0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:34.098977 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a885bbee-9abe-464e-b1cc-2e6a6d5eebf0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:34.100018 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a885bbee-9abe-464e-b1cc-2e6a6d5eebf0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:34.100757 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a885bbee-9abe-464e-b1cc-2e6a6d5eebf0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:34.272298 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a885bbee-9abe-464e-b1cc-2e6a6d5eebf0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:34.300132 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a885bbee-9abe-464e-b1cc-2e6a6d5eebf0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:34.302752 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a885bbee-9abe-464e-b1cc-2e6a6d5eebf0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:34.307353 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a885bbee-9abe-464e-b1cc-2e6a6d5eebf0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1737 microversion: 2.20 time: 0.237252 Nov 16 00:31:34.308468 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 181/366] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:34 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:34.315576 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f1fb400b-3b74-4f5a-8dd3-a42a69ac49ca tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:34.316215 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f1fb400b-3b74-4f5a-8dd3-a42a69ac49ca tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:34.332736 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f1fb400b-3b74-4f5a-8dd3-a42a69ac49ca tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:34.333292 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f1fb400b-3b74-4f5a-8dd3-a42a69ac49ca tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:34.334209 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f1fb400b-3b74-4f5a-8dd3-a42a69ac49ca tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:34.334731 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f1fb400b-3b74-4f5a-8dd3-a42a69ac49ca tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:34.432439 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-d35a6af3-2beb-4570-b959-4a5eae450e4f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Flavor limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:31:34.432831 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-d35a6af3-2beb-4570-b959-4a5eae450e4f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Image limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:31:34.433309 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-d35a6af3-2beb-4570-b959-4a5eae450e4f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Flavor pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:31:34.434701 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-d35a6af3-2beb-4570-b959-4a5eae450e4f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Image pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:31:34.435174 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-d35a6af3-2beb-4570-b959-4a5eae450e4f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:31:34.447139 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d35a6af3-2beb-4570-b959-4a5eae450e4f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:34.447653 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d35a6af3-2beb-4570-b959-4a5eae450e4f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:34.448647 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d35a6af3-2beb-4570-b959-4a5eae450e4f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:34.449307 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d35a6af3-2beb-4570-b959-4a5eae450e4f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:34.472421 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-d35a6af3-2beb-4570-b959-4a5eae450e4f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Getting quotas for project 4262ca01104142daa42d05ef22e0d643. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:31:34.477161 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-d35a6af3-2beb-4570-b959-4a5eae450e4f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Getting quotas for user 8bacb60350ce449d97bf145ddb25af28 and project 4262ca01104142daa42d05ef22e0d643. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:31:34.494286 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d35a6af3-2beb-4570-b959-4a5eae450e4f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Going to run 1 instances... {{(pid=122543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:31:34.496807 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d35a6af3-2beb-4570-b959-4a5eae450e4f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb47ca05-3b48-4f1c-bc96-e0c5c672caba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:31:34.586015 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-f1fb400b-3b74-4f5a-8dd3-a42a69ac49ca tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:34.602326 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-f1fb400b-3b74-4f5a-8dd3-a42a69ac49ca tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1566 microversion: 2.1 time: 0.292665 Nov 16 00:31:34.602574 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-d35a6af3-2beb-4570-b959-4a5eae450e4f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.664258 Nov 16 00:31:34.614002 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 186/367] 10.222.0.31 () {60 vars in 1146 bytes} [Tue Nov 16 00:31:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 2668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 00:31:34.615396 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 182/368] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:34 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1566 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:34.620976 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c6590f3e-2d5a-4d41-ac9a-38b9573850f1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-383207408", "imageRef": "0c08bec9-0204-49dd-833b-ed78686cd6e4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1457930364", "networks": [{"uuid": "222d0e06-41bd-4a7b-8ea0-064a7ea2f422"}]}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:31:34.626986 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-fc49c547-9540-47b7-962b-60617ff5a418 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:34.627943 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-fc49c547-9540-47b7-962b-60617ff5a418 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:34.743320 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-fc49c547-9540-47b7-962b-60617ff5a418 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:34.759970 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-fc49c547-9540-47b7-962b-60617ff5a418 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1215 microversion: 2.1 time: 0.139193 Nov 16 00:31:34.761566 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 183/369] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:34 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1215 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:34.804315 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.network.neutron [None req-c6590f3e-2d5a-4d41-ac9a-38b9573850f1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] validate_networks() for [('222d0e06-41bd-4a7b-8ea0-064a7ea2f422', None, None, None, None, None)] {{(pid=122543) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:31:35.348110 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-62404bcf-923f-48a8-9b6b-e97b56a38e14 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:35.353181 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-62404bcf-923f-48a8-9b6b-e97b56a38e14 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:35.391148 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-62404bcf-923f-48a8-9b6b-e97b56a38e14 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:35.394923 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-62404bcf-923f-48a8-9b6b-e97b56a38e14 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:35.397211 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-62404bcf-923f-48a8-9b6b-e97b56a38e14 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:35.401859 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-62404bcf-923f-48a8-9b6b-e97b56a38e14 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:35.699142 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-c6590f3e-2d5a-4d41-ac9a-38b9573850f1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Flavor limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:31:35.700575 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-c6590f3e-2d5a-4d41-ac9a-38b9573850f1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Image limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:31:35.701259 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-c6590f3e-2d5a-4d41-ac9a-38b9573850f1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Flavor pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:31:35.701909 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-c6590f3e-2d5a-4d41-ac9a-38b9573850f1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Image pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:31:35.702988 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-c6590f3e-2d5a-4d41-ac9a-38b9573850f1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:31:35.719714 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c6590f3e-2d5a-4d41-ac9a-38b9573850f1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:35.720909 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c6590f3e-2d5a-4d41-ac9a-38b9573850f1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:35.721976 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c6590f3e-2d5a-4d41-ac9a-38b9573850f1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:35.723614 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c6590f3e-2d5a-4d41-ac9a-38b9573850f1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:35.772730 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-c6590f3e-2d5a-4d41-ac9a-38b9573850f1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Getting quotas for project 7d4495714639486cad8d6a4039009581. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:31:35.781389 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-c6590f3e-2d5a-4d41-ac9a-38b9573850f1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Getting quotas for user 7f1b83dddb4a4bf5bac2ae8804a59f1f and project 7d4495714639486cad8d6a4039009581. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:31:35.806252 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c6590f3e-2d5a-4d41-ac9a-38b9573850f1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Going to run 1 instances... {{(pid=122543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:31:35.811028 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c6590f3e-2d5a-4d41-ac9a-38b9573850f1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0c08bec9-0204-49dd-833b-ed78686cd6e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:31:35.821854 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-62404bcf-923f-48a8-9b6b-e97b56a38e14 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:35.842148 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-62404bcf-923f-48a8-9b6b-e97b56a38e14 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:35.846018 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-62404bcf-923f-48a8-9b6b-e97b56a38e14 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:35.847307 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-62404bcf-923f-48a8-9b6b-e97b56a38e14 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1737 microversion: 2.20 time: 0.522224 Nov 16 00:31:35.847888 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 184/370] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:35 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1737 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:35.860958 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-13239dcc-878c-4404-8b1d-ff6398f4373e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:35.861593 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-13239dcc-878c-4404-8b1d-ff6398f4373e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:35.877696 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-13239dcc-878c-4404-8b1d-ff6398f4373e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:35.878014 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-13239dcc-878c-4404-8b1d-ff6398f4373e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:35.878809 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-13239dcc-878c-4404-8b1d-ff6398f4373e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:35.882224 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-13239dcc-878c-4404-8b1d-ff6398f4373e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:35.961848 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c6590f3e-2d5a-4d41-ac9a-38b9573850f1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.351000 Nov 16 00:31:35.986874 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 187/371] 10.222.0.31 () {60 vars in 1146 bytes} [Tue Nov 16 00:31:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 1382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 00:31:35.996434 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-d2b9614f-7193-46a7-9ce2-9fde464d7515 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:35.998178 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d2b9614f-7193-46a7-9ce2-9fde464d7515 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:36.018091 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d2b9614f-7193-46a7-9ce2-9fde464d7515 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:36.022806 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d2b9614f-7193-46a7-9ce2-9fde464d7515 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:36.024126 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d2b9614f-7193-46a7-9ce2-9fde464d7515 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:36.025056 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d2b9614f-7193-46a7-9ce2-9fde464d7515 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:36.138561 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-13239dcc-878c-4404-8b1d-ff6398f4373e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:36.148528 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-13239dcc-878c-4404-8b1d-ff6398f4373e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1566 microversion: 2.1 time: 0.299550 Nov 16 00:31:36.149112 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 185/372] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:35 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1566 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:36.156257 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-c9b6e4c5-1743-4656-b41c-a0a99418a702 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:36.157180 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-c9b6e4c5-1743-4656-b41c-a0a99418a702 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:36.195838 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-d2b9614f-7193-46a7-9ce2-9fde464d7515 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:36.221992 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-d2b9614f-7193-46a7-9ce2-9fde464d7515 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1267 microversion: 2.1 time: 0.230800 Nov 16 00:31:36.234681 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 188/373] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:35 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1267 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:36.265575 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-c9b6e4c5-1743-4656-b41c-a0a99418a702 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:36.273943 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-c9b6e4c5-1743-4656-b41c-a0a99418a702 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1258 microversion: 2.1 time: 0.123533 Nov 16 00:31:36.284777 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 186/374] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:36 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1258 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:36.873234 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c29fbd5b-4ad5-4b5a-83b0-ef831b137d44 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:36.876444 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c29fbd5b-4ad5-4b5a-83b0-ef831b137d44 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:36.910309 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c29fbd5b-4ad5-4b5a-83b0-ef831b137d44 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:36.913550 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c29fbd5b-4ad5-4b5a-83b0-ef831b137d44 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:36.917295 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c29fbd5b-4ad5-4b5a-83b0-ef831b137d44 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:36.927016 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c29fbd5b-4ad5-4b5a-83b0-ef831b137d44 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:37.169873 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d5f7fd9a-f947-4d76-ac97-210d107b3eb1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:37.172674 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d5f7fd9a-f947-4d76-ac97-210d107b3eb1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:37.201522 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d5f7fd9a-f947-4d76-ac97-210d107b3eb1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:37.213949 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d5f7fd9a-f947-4d76-ac97-210d107b3eb1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:37.215538 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d5f7fd9a-f947-4d76-ac97-210d107b3eb1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:37.216350 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d5f7fd9a-f947-4d76-ac97-210d107b3eb1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:37.319128 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c29fbd5b-4ad5-4b5a-83b0-ef831b137d44 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:37.340908 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c29fbd5b-4ad5-4b5a-83b0-ef831b137d44 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:37.346750 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c29fbd5b-4ad5-4b5a-83b0-ef831b137d44 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:37.349869 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c29fbd5b-4ad5-4b5a-83b0-ef831b137d44 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1737 microversion: 2.20 time: 0.485626 Nov 16 00:31:37.356861 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 189/375] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:36 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1737 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:31:37.366612 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-b74bfa85-b464-45a6-9b3f-8bf526b0fdf4 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:37.367623 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b74bfa85-b464-45a6-9b3f-8bf526b0fdf4 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:37.395145 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b74bfa85-b464-45a6-9b3f-8bf526b0fdf4 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:37.395749 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b74bfa85-b464-45a6-9b3f-8bf526b0fdf4 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:37.397046 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b74bfa85-b464-45a6-9b3f-8bf526b0fdf4 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:37.400275 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b74bfa85-b464-45a6-9b3f-8bf526b0fdf4 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:37.529597 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-b74bfa85-b464-45a6-9b3f-8bf526b0fdf4 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:37.550111 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-b74bfa85-b464-45a6-9b3f-8bf526b0fdf4 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1273 microversion: 2.1 time: 0.189573 Nov 16 00:31:37.551936 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 190/376] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:37 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1273 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:37.561475 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-0d5e8638-e8cc-44f8-8422-22e508dbf85b tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:37.563004 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-0d5e8638-e8cc-44f8-8422-22e508dbf85b tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:37.577506 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0d5e8638-e8cc-44f8-8422-22e508dbf85b tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:37.578655 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0d5e8638-e8cc-44f8-8422-22e508dbf85b tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:37.580607 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0d5e8638-e8cc-44f8-8422-22e508dbf85b tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:37.581596 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0d5e8638-e8cc-44f8-8422-22e508dbf85b tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:37.700086 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-0d5e8638-e8cc-44f8-8422-22e508dbf85b tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:37.716626 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-0d5e8638-e8cc-44f8-8422-22e508dbf85b tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1254 microversion: 2.1 time: 0.162467 Nov 16 00:31:37.718651 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 191/377] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:37 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1254 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:37.951151 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d5f7fd9a-f947-4d76-ac97-210d107b3eb1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:37.973108 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d5f7fd9a-f947-4d76-ac97-210d107b3eb1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1546 microversion: 2.1 time: 0.809996 Nov 16 00:31:37.987084 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 187/378] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:37 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1546 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:38.008428 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8979bc76-2bb3-4622-9232-7d502fab34fc tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:38.009191 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8979bc76-2bb3-4622-9232-7d502fab34fc tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:38.019494 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8979bc76-2bb3-4622-9232-7d502fab34fc tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:38.020296 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8979bc76-2bb3-4622-9232-7d502fab34fc tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:38.021303 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8979bc76-2bb3-4622-9232-7d502fab34fc tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:38.021920 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8979bc76-2bb3-4622-9232-7d502fab34fc tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:38.222619 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-8979bc76-2bb3-4622-9232-7d502fab34fc tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] HTTP exception thrown: Cannot 'detach_volume' instance 896600e3-829b-43f9-87af-60d271f05432 while it is in vm_state rescued Nov 16 00:31:38.223714 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8979bc76-2bb3-4622-9232-7d502fab34fc tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Returning 409 to user: Cannot 'detach_volume' instance 896600e3-829b-43f9-87af-60d271f05432 while it is in vm_state rescued {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:31:38.224702 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8979bc76-2bb3-4622-9232-7d502fab34fc tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "DELETE /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432/os-volume_attachments/6a7c049b-a455-4d52-a3d5-d00dd6d196a3" status: 409 len: 152 microversion: 2.1 time: 0.228045 Nov 16 00:31:38.225295 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 192/379] 10.222.0.31 () {58 vars in 1415 bytes} [Tue Nov 16 00:31:37 2021] DELETE /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432/os-volume_attachments/6a7c049b-a455-4d52-a3d5-d00dd6d196a3 => generated 152 bytes in 229 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 16 00:31:38.236961 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3c5cca22-be91-48af-b67b-2380d2e18771 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:31:38.238576 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3c5cca22-be91-48af-b67b-2380d2e18771 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:38.245619 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3c5cca22-be91-48af-b67b-2380d2e18771 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:38.246486 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3c5cca22-be91-48af-b67b-2380d2e18771 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:38.247737 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3c5cca22-be91-48af-b67b-2380d2e18771 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:38.248417 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3c5cca22-be91-48af-b67b-2380d2e18771 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:38.381633 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-3c5cca22-be91-48af-b67b-2380d2e18771 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "POST /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432/action" status: 202 len: 0 microversion: 2.1 time: 0.148697 Nov 16 00:31:38.382475 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 188/380] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:31:38 2021] POST /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:31:38.396993 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-07320023-cab4-45b1-92da-b56bff64178c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:38.396993 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-07320023-cab4-45b1-92da-b56bff64178c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:38.412788 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-4ddf32cf-c8c4-4fc8-92aa-14f2f92c5bc5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:38.414273 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-4ddf32cf-c8c4-4fc8-92aa-14f2f92c5bc5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:38.421527 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-07320023-cab4-45b1-92da-b56bff64178c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:38.422484 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-07320023-cab4-45b1-92da-b56bff64178c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:38.423807 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-07320023-cab4-45b1-92da-b56bff64178c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:38.424844 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-07320023-cab4-45b1-92da-b56bff64178c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:38.447722 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4ddf32cf-c8c4-4fc8-92aa-14f2f92c5bc5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:38.449203 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4ddf32cf-c8c4-4fc8-92aa-14f2f92c5bc5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:38.451162 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4ddf32cf-c8c4-4fc8-92aa-14f2f92c5bc5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:38.452693 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4ddf32cf-c8c4-4fc8-92aa-14f2f92c5bc5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:38.657451 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-07320023-cab4-45b1-92da-b56bff64178c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:38.673398 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-07320023-cab4-45b1-92da-b56bff64178c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:38.677757 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-07320023-cab4-45b1-92da-b56bff64178c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:38.680951 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-07320023-cab4-45b1-92da-b56bff64178c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1737 microversion: 2.20 time: 0.292018 Nov 16 00:31:38.683431 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 193/381] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:38 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1737 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:38.694515 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-7510acc5-dc31-4be6-961a-81bac3224dd9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:38.696322 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-7510acc5-dc31-4be6-961a-81bac3224dd9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:38.711486 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7510acc5-dc31-4be6-961a-81bac3224dd9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:38.713036 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7510acc5-dc31-4be6-961a-81bac3224dd9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:38.714672 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7510acc5-dc31-4be6-961a-81bac3224dd9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:38.715859 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7510acc5-dc31-4be6-961a-81bac3224dd9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:38.822146 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-4ddf32cf-c8c4-4fc8-92aa-14f2f92c5bc5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:38.827655 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-7510acc5-dc31-4be6-961a-81bac3224dd9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:38.836077 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-7510acc5-dc31-4be6-961a-81bac3224dd9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1273 microversion: 2.1 time: 0.150636 Nov 16 00:31:38.837187 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 194/382] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:38 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1273 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:38.842982 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-4ddf32cf-c8c4-4fc8-92aa-14f2f92c5bc5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1554 microversion: 2.1 time: 0.437529 Nov 16 00:31:38.844465 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 189/383] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:38 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1554 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:38.850020 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-6e924f06-02a5-423b-9f18-0ceb5f66872e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:38.851095 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-6e924f06-02a5-423b-9f18-0ceb5f66872e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:38.866634 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6e924f06-02a5-423b-9f18-0ceb5f66872e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:38.867416 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6e924f06-02a5-423b-9f18-0ceb5f66872e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:38.868437 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6e924f06-02a5-423b-9f18-0ceb5f66872e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:38.868995 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6e924f06-02a5-423b-9f18-0ceb5f66872e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:38.987282 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-6e924f06-02a5-423b-9f18-0ceb5f66872e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:39.005447 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-6e924f06-02a5-423b-9f18-0ceb5f66872e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1310 microversion: 2.1 time: 0.166831 Nov 16 00:31:39.006385 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 195/384] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:38 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1310 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:39.708500 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-10f9db67-03cb-4b33-8825-97b4a9ec6e8c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:39.712122 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-10f9db67-03cb-4b33-8825-97b4a9ec6e8c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:39.723619 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-10f9db67-03cb-4b33-8825-97b4a9ec6e8c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:39.724426 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-10f9db67-03cb-4b33-8825-97b4a9ec6e8c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:39.725488 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-10f9db67-03cb-4b33-8825-97b4a9ec6e8c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:39.726147 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-10f9db67-03cb-4b33-8825-97b4a9ec6e8c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:39.879371 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8977a8c0-1c4e-4248-8b31-86298d5ad2f0 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:39.880450 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8977a8c0-1c4e-4248-8b31-86298d5ad2f0 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:39.901388 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8977a8c0-1c4e-4248-8b31-86298d5ad2f0 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:39.901903 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8977a8c0-1c4e-4248-8b31-86298d5ad2f0 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:39.902804 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8977a8c0-1c4e-4248-8b31-86298d5ad2f0 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:39.903473 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8977a8c0-1c4e-4248-8b31-86298d5ad2f0 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:40.019003 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-10f9db67-03cb-4b33-8825-97b4a9ec6e8c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:40.033623 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-10f9db67-03cb-4b33-8825-97b4a9ec6e8c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:40.035511 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-10f9db67-03cb-4b33-8825-97b4a9ec6e8c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:40.039604 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-10f9db67-03cb-4b33-8825-97b4a9ec6e8c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1719 microversion: 2.20 time: 0.339862 Nov 16 00:31:40.054094 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 190/385] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:39 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1719 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:40.062476 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-997a99f1-fada-444b-a80f-1dfa40acd8e0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:40.066887 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-997a99f1-fada-444b-a80f-1dfa40acd8e0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:40.074220 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-997a99f1-fada-444b-a80f-1dfa40acd8e0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:40.074827 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-997a99f1-fada-444b-a80f-1dfa40acd8e0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:40.075814 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-997a99f1-fada-444b-a80f-1dfa40acd8e0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:40.076334 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-997a99f1-fada-444b-a80f-1dfa40acd8e0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:40.457307 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-997a99f1-fada-444b-a80f-1dfa40acd8e0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:40.486037 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-997a99f1-fada-444b-a80f-1dfa40acd8e0 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1554 microversion: 2.1 time: 0.430614 Nov 16 00:31:40.491837 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 191/386] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:40 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1554 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:40.512490 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f32fa31d-7ec0-4445-99ea-0eea24daf321 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:40.519095 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f32fa31d-7ec0-4445-99ea-0eea24daf321 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:40.543747 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f32fa31d-7ec0-4445-99ea-0eea24daf321 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:40.548493 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f32fa31d-7ec0-4445-99ea-0eea24daf321 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:40.552243 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f32fa31d-7ec0-4445-99ea-0eea24daf321 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:40.556183 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f32fa31d-7ec0-4445-99ea-0eea24daf321 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:40.575955 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-8977a8c0-1c4e-4248-8b31-86298d5ad2f0 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:40.587518 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8977a8c0-1c4e-4248-8b31-86298d5ad2f0 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.724086 Nov 16 00:31:40.588358 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 196/387] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:39 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:40.712300 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-2da14ad3-4aa8-4124-ac20-b4e2cc00eec5 req-f114781f-10e3-45a9-b10e-1eafab6fc244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44cd98fe-3bda-4129-a9d1-ad922d5c3d10", "tag": "b6e9163c-8268-4e52-8726-8961a776e608"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:31:40.714427 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:31:40.714427 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:31:40.728115 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-2da14ad3-4aa8-4124-ac20-b4e2cc00eec5 req-f114781f-10e3-45a9-b10e-1eafab6fc244 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:40.728934 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-2da14ad3-4aa8-4124-ac20-b4e2cc00eec5 req-f114781f-10e3-45a9-b10e-1eafab6fc244 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:40.761209 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-2da14ad3-4aa8-4124-ac20-b4e2cc00eec5 req-f114781f-10e3-45a9-b10e-1eafab6fc244 service nova] Creating event network-changed:b6e9163c-8268-4e52-8726-8961a776e608 for instance 44cd98fe-3bda-4129-a9d1-ad922d5c3d10 on hv-cinder-81115 Nov 16 00:31:40.788661 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-2da14ad3-4aa8-4124-ac20-b4e2cc00eec5 req-f114781f-10e3-45a9-b10e-1eafab6fc244 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080193 Nov 16 00:31:40.789353 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 197/388] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:31:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:31:40.832483 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-f32fa31d-7ec0-4445-99ea-0eea24daf321 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:40.865519 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-f32fa31d-7ec0-4445-99ea-0eea24daf321 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1316 microversion: 2.1 time: 0.370777 Nov 16 00:31:40.867319 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 192/389] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:40 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1316 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:41.062809 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-b0d5ad94-dabc-4db5-92d0-d0f1ae4a678b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:41.064305 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b0d5ad94-dabc-4db5-92d0-d0f1ae4a678b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:41.080636 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b0d5ad94-dabc-4db5-92d0-d0f1ae4a678b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:41.081486 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b0d5ad94-dabc-4db5-92d0-d0f1ae4a678b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:41.084275 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b0d5ad94-dabc-4db5-92d0-d0f1ae4a678b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:41.085044 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b0d5ad94-dabc-4db5-92d0-d0f1ae4a678b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:41.371606 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-b0d5ad94-dabc-4db5-92d0-d0f1ae4a678b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:41.384347 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-b0d5ad94-dabc-4db5-92d0-d0f1ae4a678b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:41.386947 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-b0d5ad94-dabc-4db5-92d0-d0f1ae4a678b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:41.388761 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-b0d5ad94-dabc-4db5-92d0-d0f1ae4a678b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1719 microversion: 2.20 time: 0.331697 Nov 16 00:31:41.390593 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 198/390] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:41 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1719 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:41.508950 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-7a53c469-84fa-4df7-863b-a2112458b3c5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:41.509946 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-7a53c469-84fa-4df7-863b-a2112458b3c5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:41.520303 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7a53c469-84fa-4df7-863b-a2112458b3c5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:41.524672 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7a53c469-84fa-4df7-863b-a2112458b3c5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:41.526230 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7a53c469-84fa-4df7-863b-a2112458b3c5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:41.529763 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7a53c469-84fa-4df7-863b-a2112458b3c5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:41.606437 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-0fca8175-d1e6-47c9-9264-1bc58e383591 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:41.607036 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-0fca8175-d1e6-47c9-9264-1bc58e383591 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:41.619716 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0fca8175-d1e6-47c9-9264-1bc58e383591 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:41.620163 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0fca8175-d1e6-47c9-9264-1bc58e383591 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:41.621051 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0fca8175-d1e6-47c9-9264-1bc58e383591 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:41.627578 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0fca8175-d1e6-47c9-9264-1bc58e383591 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:41.753117 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-7a53c469-84fa-4df7-863b-a2112458b3c5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:41.763691 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-7a53c469-84fa-4df7-863b-a2112458b3c5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1554 microversion: 2.1 time: 0.258478 Nov 16 00:31:41.766060 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 193/391] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:41 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1554 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:41.883483 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-0fca8175-d1e6-47c9-9264-1bc58e383591 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:41.895136 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e0a37d43-5fe4-40e1-a51a-84fd4c930439 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:41.895853 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e0a37d43-5fe4-40e1-a51a-84fd4c930439 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:41.901456 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-0fca8175-d1e6-47c9-9264-1bc58e383591 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.298707 Nov 16 00:31:41.902462 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 199/392] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:41 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:41.902725 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e0a37d43-5fe4-40e1-a51a-84fd4c930439 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:41.903230 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e0a37d43-5fe4-40e1-a51a-84fd4c930439 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:41.904078 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e0a37d43-5fe4-40e1-a51a-84fd4c930439 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:41.904568 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e0a37d43-5fe4-40e1-a51a-84fd4c930439 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:42.049957 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e0a37d43-5fe4-40e1-a51a-84fd4c930439 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:42.059224 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e0a37d43-5fe4-40e1-a51a-84fd4c930439 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.168229 Nov 16 00:31:42.060778 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 194/393] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:41 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:42.426325 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-d6e67ff6-f190-4a1f-909d-537b20256e82 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:42.427571 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d6e67ff6-f190-4a1f-909d-537b20256e82 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:42.434801 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d6e67ff6-f190-4a1f-909d-537b20256e82 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:42.435283 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d6e67ff6-f190-4a1f-909d-537b20256e82 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:42.436149 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d6e67ff6-f190-4a1f-909d-537b20256e82 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:42.436769 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d6e67ff6-f190-4a1f-909d-537b20256e82 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:42.614632 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-d6e67ff6-f190-4a1f-909d-537b20256e82 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:42.638064 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-d6e67ff6-f190-4a1f-909d-537b20256e82 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:42.642423 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-d6e67ff6-f190-4a1f-909d-537b20256e82 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:42.644190 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-d6e67ff6-f190-4a1f-909d-537b20256e82 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1719 microversion: 2.20 time: 0.224962 Nov 16 00:31:42.645782 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 200/394] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:42 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1719 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:42.793699 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-74259b29-98c9-42cd-9c71-6255503b4a81 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:42.794789 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-74259b29-98c9-42cd-9c71-6255503b4a81 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:42.808454 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-74259b29-98c9-42cd-9c71-6255503b4a81 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:42.810149 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-74259b29-98c9-42cd-9c71-6255503b4a81 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:42.813402 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-74259b29-98c9-42cd-9c71-6255503b4a81 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:42.814249 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-74259b29-98c9-42cd-9c71-6255503b4a81 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:42.922469 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-3fa53617-d292-470f-96da-d968402373bf tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:42.923193 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-3fa53617-d292-470f-96da-d968402373bf tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:42.930070 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3fa53617-d292-470f-96da-d968402373bf tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:42.930511 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3fa53617-d292-470f-96da-d968402373bf tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:42.931340 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3fa53617-d292-470f-96da-d968402373bf tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:42.931774 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3fa53617-d292-470f-96da-d968402373bf tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:43.017373 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-74259b29-98c9-42cd-9c71-6255503b4a81 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:43.027372 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-74259b29-98c9-42cd-9c71-6255503b4a81 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1554 microversion: 2.1 time: 0.247887 Nov 16 00:31:43.028194 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 195/395] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:42 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1554 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:43.093045 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-249ea6e7-ad7f-4261-8376-2832ab55efec tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:43.094177 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-249ea6e7-ad7f-4261-8376-2832ab55efec tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:43.112982 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-249ea6e7-ad7f-4261-8376-2832ab55efec tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:43.117300 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-249ea6e7-ad7f-4261-8376-2832ab55efec tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:43.122211 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-249ea6e7-ad7f-4261-8376-2832ab55efec tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:43.129250 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-249ea6e7-ad7f-4261-8376-2832ab55efec tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:43.232957 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-3fa53617-d292-470f-96da-d968402373bf tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:43.243149 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-3fa53617-d292-470f-96da-d968402373bf tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.325943 Nov 16 00:31:43.243867 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 201/396] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:42 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:43.317031 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-249ea6e7-ad7f-4261-8376-2832ab55efec tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:43.325055 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-249ea6e7-ad7f-4261-8376-2832ab55efec tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.239117 Nov 16 00:31:43.325673 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 196/397] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:43 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:43.675639 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-45786129-7744-45cc-abd9-41eee27475da tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:43.676533 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-45786129-7744-45cc-abd9-41eee27475da tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:43.683235 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-45786129-7744-45cc-abd9-41eee27475da tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:43.683688 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-45786129-7744-45cc-abd9-41eee27475da tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:43.684518 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-45786129-7744-45cc-abd9-41eee27475da tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:43.684993 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-45786129-7744-45cc-abd9-41eee27475da tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:43.826244 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-c6345ecf-1c8f-4f2e-b396-8e7ca5cfd5f7 req-42014493-69fe-4cba-89da-a0d27c5d77d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f9b823f-75c2-4baf-9577-5dc85ec77405", "name": "network-vif-unplugged", "status": "completed", "tag": "10abc4a6-a723-4a5c-855b-11d4b6d40eb9"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:31:43.829089 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:31:43.829089 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:31:43.836143 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-45786129-7744-45cc-abd9-41eee27475da tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:43.845044 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-c6345ecf-1c8f-4f2e-b396-8e7ca5cfd5f7 req-42014493-69fe-4cba-89da-a0d27c5d77d7 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:43.845700 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-c6345ecf-1c8f-4f2e-b396-8e7ca5cfd5f7 req-42014493-69fe-4cba-89da-a0d27c5d77d7 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:43.853978 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-45786129-7744-45cc-abd9-41eee27475da tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:43.857177 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-45786129-7744-45cc-abd9-41eee27475da tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:43.859997 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-45786129-7744-45cc-abd9-41eee27475da tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1719 microversion: 2.20 time: 0.188565 Nov 16 00:31:43.861052 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 202/398] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:43 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1719 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:43.866476 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-c6345ecf-1c8f-4f2e-b396-8e7ca5cfd5f7 req-42014493-69fe-4cba-89da-a0d27c5d77d7 service nova] Creating event network-vif-unplugged:10abc4a6-a723-4a5c-855b-11d4b6d40eb9 for instance 3f9b823f-75c2-4baf-9577-5dc85ec77405 on hv-cinder-81115 Nov 16 00:31:43.872715 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-c6345ecf-1c8f-4f2e-b396-8e7ca5cfd5f7 req-42014493-69fe-4cba-89da-a0d27c5d77d7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050144 Nov 16 00:31:43.874004 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 197/399] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:31:43 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:31:44.057943 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-68b61d47-2c9a-4c01-a2d2-52ea555a363d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:44.058681 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-68b61d47-2c9a-4c01-a2d2-52ea555a363d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:44.066224 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-68b61d47-2c9a-4c01-a2d2-52ea555a363d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:44.066724 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-68b61d47-2c9a-4c01-a2d2-52ea555a363d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:44.067639 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-68b61d47-2c9a-4c01-a2d2-52ea555a363d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:44.067955 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-68b61d47-2c9a-4c01-a2d2-52ea555a363d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:44.247575 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-68b61d47-2c9a-4c01-a2d2-52ea555a363d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:44.257613 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-68b61d47-2c9a-4c01-a2d2-52ea555a363d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1554 microversion: 2.1 time: 0.203270 Nov 16 00:31:44.258561 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 203/400] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:44 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1554 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:44.276591 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e6c4f2ff-0733-420e-becf-1dd000421c5b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:44.277872 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e6c4f2ff-0733-420e-becf-1dd000421c5b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:44.292015 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e6c4f2ff-0733-420e-becf-1dd000421c5b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:44.293130 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e6c4f2ff-0733-420e-becf-1dd000421c5b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:44.294639 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e6c4f2ff-0733-420e-becf-1dd000421c5b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:44.295318 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e6c4f2ff-0733-420e-becf-1dd000421c5b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:44.344825 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ef6dac59-aeac-40c5-8d9d-c83de7298f01 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:44.346315 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ef6dac59-aeac-40c5-8d9d-c83de7298f01 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:44.356659 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ef6dac59-aeac-40c5-8d9d-c83de7298f01 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:44.357098 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ef6dac59-aeac-40c5-8d9d-c83de7298f01 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:44.359188 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ef6dac59-aeac-40c5-8d9d-c83de7298f01 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:44.359627 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ef6dac59-aeac-40c5-8d9d-c83de7298f01 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:44.468374 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e6c4f2ff-0733-420e-becf-1dd000421c5b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:44.479217 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e6c4f2ff-0733-420e-becf-1dd000421c5b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.209758 Nov 16 00:31:44.480334 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 198/401] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:44 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:44.524967 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-ef6dac59-aeac-40c5-8d9d-c83de7298f01 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:44.533257 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ef6dac59-aeac-40c5-8d9d-c83de7298f01 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.194711 Nov 16 00:31:44.533869 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 204/402] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:44 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:44.879592 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-71952625-15dc-4998-b3f4-85d4066a5e51 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:44.880240 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-71952625-15dc-4998-b3f4-85d4066a5e51 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:44.886532 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-71952625-15dc-4998-b3f4-85d4066a5e51 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:44.886967 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-71952625-15dc-4998-b3f4-85d4066a5e51 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:44.887756 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-71952625-15dc-4998-b3f4-85d4066a5e51 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:44.888252 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-71952625-15dc-4998-b3f4-85d4066a5e51 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:45.017551 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-71952625-15dc-4998-b3f4-85d4066a5e51 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:45.025749 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-71952625-15dc-4998-b3f4-85d4066a5e51 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:45.027262 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-71952625-15dc-4998-b3f4-85d4066a5e51 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:45.028418 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-71952625-15dc-4998-b3f4-85d4066a5e51 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1719 microversion: 2.20 time: 0.152640 Nov 16 00:31:45.028981 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 199/403] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:44 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:45.285746 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8983687e-9545-4a6c-afe7-f6a505475838 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:45.286351 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8983687e-9545-4a6c-afe7-f6a505475838 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:45.293153 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8983687e-9545-4a6c-afe7-f6a505475838 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:45.293590 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8983687e-9545-4a6c-afe7-f6a505475838 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:45.294382 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8983687e-9545-4a6c-afe7-f6a505475838 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:45.294819 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8983687e-9545-4a6c-afe7-f6a505475838 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:45.473345 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-8983687e-9545-4a6c-afe7-f6a505475838 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:45.487698 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8983687e-9545-4a6c-afe7-f6a505475838 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1554 microversion: 2.1 time: 0.205801 Nov 16 00:31:45.496132 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 205/404] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:45 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1554 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:45.503552 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d032f55d-f138-4c79-8413-3ada4393735e tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:45.504640 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d032f55d-f138-4c79-8413-3ada4393735e tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:45.512262 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d032f55d-f138-4c79-8413-3ada4393735e tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:45.512850 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d032f55d-f138-4c79-8413-3ada4393735e tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:45.513842 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d032f55d-f138-4c79-8413-3ada4393735e tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:45.514536 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d032f55d-f138-4c79-8413-3ada4393735e tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:45.555856 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8cb3fd47-e812-45be-b745-ad03beb33898 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:45.557108 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8cb3fd47-e812-45be-b745-ad03beb33898 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:45.569956 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8cb3fd47-e812-45be-b745-ad03beb33898 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:45.570535 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8cb3fd47-e812-45be-b745-ad03beb33898 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:45.571714 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8cb3fd47-e812-45be-b745-ad03beb33898 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:45.572236 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8cb3fd47-e812-45be-b745-ad03beb33898 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:45.683595 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d032f55d-f138-4c79-8413-3ada4393735e tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:45.706455 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d032f55d-f138-4c79-8413-3ada4393735e tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.208243 Nov 16 00:31:45.711129 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 200/405] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:45 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:45.777569 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-8cb3fd47-e812-45be-b745-ad03beb33898 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:45.785391 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8cb3fd47-e812-45be-b745-ad03beb33898 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.236200 Nov 16 00:31:45.785970 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 206/406] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:45 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:46.049107 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-881e03b6-3dae-4b4c-9d57-66ddddaa33e8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:46.049686 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-881e03b6-3dae-4b4c-9d57-66ddddaa33e8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:46.056375 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-881e03b6-3dae-4b4c-9d57-66ddddaa33e8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:46.056812 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-881e03b6-3dae-4b4c-9d57-66ddddaa33e8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:46.057587 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-881e03b6-3dae-4b4c-9d57-66ddddaa33e8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:46.058008 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-881e03b6-3dae-4b4c-9d57-66ddddaa33e8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:46.246918 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-881e03b6-3dae-4b4c-9d57-66ddddaa33e8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:46.257633 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-881e03b6-3dae-4b4c-9d57-66ddddaa33e8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:46.260355 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-881e03b6-3dae-4b4c-9d57-66ddddaa33e8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:46.261548 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-881e03b6-3dae-4b4c-9d57-66ddddaa33e8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1719 microversion: 2.20 time: 0.216974 Nov 16 00:31:46.262111 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 201/407] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:46 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1719 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:46.505908 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-47c47a6c-6966-4494-a03a-dbbb2d867f5e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:46.506502 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-47c47a6c-6966-4494-a03a-dbbb2d867f5e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:46.512479 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-47c47a6c-6966-4494-a03a-dbbb2d867f5e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:46.512921 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-47c47a6c-6966-4494-a03a-dbbb2d867f5e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:46.513746 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-47c47a6c-6966-4494-a03a-dbbb2d867f5e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:46.515315 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-47c47a6c-6966-4494-a03a-dbbb2d867f5e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:46.666486 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-47c47a6c-6966-4494-a03a-dbbb2d867f5e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:46.687142 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-47c47a6c-6966-4494-a03a-dbbb2d867f5e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1554 microversion: 2.1 time: 0.183314 Nov 16 00:31:46.689257 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 207/408] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:46 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:46.728584 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-118c099b-aaac-4b69-aba7-cea4df33362b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:46.729231 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-118c099b-aaac-4b69-aba7-cea4df33362b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:46.736993 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-118c099b-aaac-4b69-aba7-cea4df33362b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:46.737440 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-118c099b-aaac-4b69-aba7-cea4df33362b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:46.738224 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-118c099b-aaac-4b69-aba7-cea4df33362b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:46.738658 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-118c099b-aaac-4b69-aba7-cea4df33362b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:46.803984 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-fca25921-d306-4c59-97fb-9dcc8b0d1b71 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:46.804701 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-fca25921-d306-4c59-97fb-9dcc8b0d1b71 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:46.810697 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fca25921-d306-4c59-97fb-9dcc8b0d1b71 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:46.811325 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fca25921-d306-4c59-97fb-9dcc8b0d1b71 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:46.812239 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fca25921-d306-4c59-97fb-9dcc8b0d1b71 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:46.812770 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fca25921-d306-4c59-97fb-9dcc8b0d1b71 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:46.886977 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-118c099b-aaac-4b69-aba7-cea4df33362b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:46.895474 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-118c099b-aaac-4b69-aba7-cea4df33362b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.170559 Nov 16 00:31:46.896173 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 202/409] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:46 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:46.970662 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-fca25921-d306-4c59-97fb-9dcc8b0d1b71 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:46.992619 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-fca25921-d306-4c59-97fb-9dcc8b0d1b71 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.192265 Nov 16 00:31:46.993362 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 208/410] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:46 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:47.282619 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-74a1e1e4-91b6-48dc-ae95-8419360bfb11 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:47.283585 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-74a1e1e4-91b6-48dc-ae95-8419360bfb11 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:47.291327 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-74a1e1e4-91b6-48dc-ae95-8419360bfb11 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:47.291773 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-74a1e1e4-91b6-48dc-ae95-8419360bfb11 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:47.292561 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-74a1e1e4-91b6-48dc-ae95-8419360bfb11 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:47.292993 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-74a1e1e4-91b6-48dc-ae95-8419360bfb11 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:47.438170 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-74a1e1e4-91b6-48dc-ae95-8419360bfb11 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:47.446472 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-74a1e1e4-91b6-48dc-ae95-8419360bfb11 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:47.448128 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-74a1e1e4-91b6-48dc-ae95-8419360bfb11 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:47.449302 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-74a1e1e4-91b6-48dc-ae95-8419360bfb11 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1719 microversion: 2.20 time: 0.172763 Nov 16 00:31:47.449861 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 203/411] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:47 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:47.707126 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-bd1a0f13-6450-4650-865b-5c8bc91294ae tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:47.707808 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-bd1a0f13-6450-4650-865b-5c8bc91294ae tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:47.713978 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bd1a0f13-6450-4650-865b-5c8bc91294ae tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:47.714418 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bd1a0f13-6450-4650-865b-5c8bc91294ae tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:47.715314 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bd1a0f13-6450-4650-865b-5c8bc91294ae tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:47.715756 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bd1a0f13-6450-4650-865b-5c8bc91294ae tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:47.877944 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-bd1a0f13-6450-4650-865b-5c8bc91294ae tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:47.888033 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-bd1a0f13-6450-4650-865b-5c8bc91294ae tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1554 microversion: 2.1 time: 0.185924 Nov 16 00:31:47.889133 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 209/412] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:47 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:47.913656 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e0014976-2643-460d-bcfe-2584b1b1e7e9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:47.914300 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e0014976-2643-460d-bcfe-2584b1b1e7e9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:47.921117 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e0014976-2643-460d-bcfe-2584b1b1e7e9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:47.921668 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e0014976-2643-460d-bcfe-2584b1b1e7e9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:47.922440 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e0014976-2643-460d-bcfe-2584b1b1e7e9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:47.922871 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e0014976-2643-460d-bcfe-2584b1b1e7e9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:48.012690 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-9a4129cd-e03d-4458-be84-c1a94ac54678 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:48.013446 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-9a4129cd-e03d-4458-be84-c1a94ac54678 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:48.028386 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9a4129cd-e03d-4458-be84-c1a94ac54678 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:48.029049 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9a4129cd-e03d-4458-be84-c1a94ac54678 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:48.035584 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9a4129cd-e03d-4458-be84-c1a94ac54678 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:48.036224 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9a4129cd-e03d-4458-be84-c1a94ac54678 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:48.106718 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e0014976-2643-460d-bcfe-2584b1b1e7e9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:48.116034 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e0014976-2643-460d-bcfe-2584b1b1e7e9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.206203 Nov 16 00:31:48.117030 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 204/413] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:47 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:48.201060 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-9a4129cd-e03d-4458-be84-c1a94ac54678 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:48.209363 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-9a4129cd-e03d-4458-be84-c1a94ac54678 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.202156 Nov 16 00:31:48.209947 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 210/414] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:48 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:48.469374 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3981bf26-c236-4f47-93e8-0352540a7dfe tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:48.469969 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3981bf26-c236-4f47-93e8-0352540a7dfe tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:48.476418 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3981bf26-c236-4f47-93e8-0352540a7dfe tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:48.476856 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3981bf26-c236-4f47-93e8-0352540a7dfe tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:48.477639 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3981bf26-c236-4f47-93e8-0352540a7dfe tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:48.478068 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3981bf26-c236-4f47-93e8-0352540a7dfe tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:48.628132 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3981bf26-c236-4f47-93e8-0352540a7dfe tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:48.636858 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3981bf26-c236-4f47-93e8-0352540a7dfe tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:48.638403 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3981bf26-c236-4f47-93e8-0352540a7dfe tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:48.640452 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-3981bf26-c236-4f47-93e8-0352540a7dfe tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1719 microversion: 2.20 time: 0.175161 Nov 16 00:31:48.641307 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 205/415] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:48 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:31:48.916664 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-d6c37466-3a0e-44ef-8627-c4eaa52f183e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:48.917288 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d6c37466-3a0e-44ef-8627-c4eaa52f183e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:48.923892 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d6c37466-3a0e-44ef-8627-c4eaa52f183e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:48.924522 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d6c37466-3a0e-44ef-8627-c4eaa52f183e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:48.925089 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d6c37466-3a0e-44ef-8627-c4eaa52f183e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:48.925516 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d6c37466-3a0e-44ef-8627-c4eaa52f183e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:49.072654 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-d6c37466-3a0e-44ef-8627-c4eaa52f183e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:49.088513 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-d6c37466-3a0e-44ef-8627-c4eaa52f183e tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1554 microversion: 2.1 time: 0.175773 Nov 16 00:31:49.090018 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 211/416] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:48 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:49.141677 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-858c8efe-9faf-40fc-967c-46f8255fd5d4 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:49.143542 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-858c8efe-9faf-40fc-967c-46f8255fd5d4 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:49.153601 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-858c8efe-9faf-40fc-967c-46f8255fd5d4 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:49.155480 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-858c8efe-9faf-40fc-967c-46f8255fd5d4 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:49.157280 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-858c8efe-9faf-40fc-967c-46f8255fd5d4 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:49.158392 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-858c8efe-9faf-40fc-967c-46f8255fd5d4 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:49.227182 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-4e738bc3-0f7b-41eb-8613-01ae9d8224c2 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:49.227803 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-4e738bc3-0f7b-41eb-8613-01ae9d8224c2 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:49.234990 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4e738bc3-0f7b-41eb-8613-01ae9d8224c2 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:49.235472 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4e738bc3-0f7b-41eb-8613-01ae9d8224c2 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:49.236265 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4e738bc3-0f7b-41eb-8613-01ae9d8224c2 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:49.236703 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4e738bc3-0f7b-41eb-8613-01ae9d8224c2 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:49.442396 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-858c8efe-9faf-40fc-967c-46f8255fd5d4 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:49.462957 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-858c8efe-9faf-40fc-967c-46f8255fd5d4 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.325940 Nov 16 00:31:49.464653 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 206/417] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:49 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:49.498824 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-4e738bc3-0f7b-41eb-8613-01ae9d8224c2 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:49.511840 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-4e738bc3-0f7b-41eb-8613-01ae9d8224c2 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.288403 Nov 16 00:31:49.515103 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 212/418] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:49 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:49.667735 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-1599843e-9c94-44dc-9412-d499412c8c70 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:49.669543 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-1599843e-9c94-44dc-9412-d499412c8c70 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:49.721817 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1599843e-9c94-44dc-9412-d499412c8c70 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:49.724340 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1599843e-9c94-44dc-9412-d499412c8c70 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:49.726553 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1599843e-9c94-44dc-9412-d499412c8c70 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:49.728027 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1599843e-9c94-44dc-9412-d499412c8c70 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:49.919480 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-1599843e-9c94-44dc-9412-d499412c8c70 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:49.936438 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-1599843e-9c94-44dc-9412-d499412c8c70 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:49.939905 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-1599843e-9c94-44dc-9412-d499412c8c70 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:49.942278 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-1599843e-9c94-44dc-9412-d499412c8c70 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1719 microversion: 2.20 time: 0.283475 Nov 16 00:31:49.943372 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 207/419] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:49 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1719 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:50.110026 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-295f139d-fa3b-4816-b67d-4ebda2985534 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:50.110737 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-295f139d-fa3b-4816-b67d-4ebda2985534 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:50.116973 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-295f139d-fa3b-4816-b67d-4ebda2985534 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:50.117413 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-295f139d-fa3b-4816-b67d-4ebda2985534 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:50.118193 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-295f139d-fa3b-4816-b67d-4ebda2985534 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:50.118622 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-295f139d-fa3b-4816-b67d-4ebda2985534 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:50.262443 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-295f139d-fa3b-4816-b67d-4ebda2985534 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:50.272005 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-295f139d-fa3b-4816-b67d-4ebda2985534 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1554 microversion: 2.1 time: 0.166052 Nov 16 00:31:50.272659 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 213/420] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:50 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:50.489889 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-dfbf98b3-7e8c-450a-bf4a-995d00a8471f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:50.490533 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-dfbf98b3-7e8c-450a-bf4a-995d00a8471f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:50.498096 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dfbf98b3-7e8c-450a-bf4a-995d00a8471f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:50.499733 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dfbf98b3-7e8c-450a-bf4a-995d00a8471f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:50.500096 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dfbf98b3-7e8c-450a-bf4a-995d00a8471f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:50.500579 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dfbf98b3-7e8c-450a-bf4a-995d00a8471f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:50.535566 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-942c1be7-d0fd-49d8-8571-38aafd025e87 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:50.547530 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-942c1be7-d0fd-49d8-8571-38aafd025e87 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:50.560032 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-942c1be7-d0fd-49d8-8571-38aafd025e87 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:50.561241 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-942c1be7-d0fd-49d8-8571-38aafd025e87 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:50.562592 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-942c1be7-d0fd-49d8-8571-38aafd025e87 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:50.563363 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-942c1be7-d0fd-49d8-8571-38aafd025e87 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:50.751719 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-dfbf98b3-7e8c-450a-bf4a-995d00a8471f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:50.770667 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-dfbf98b3-7e8c-450a-bf4a-995d00a8471f tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.284273 Nov 16 00:31:50.786227 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 208/421] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:50 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:50.798019 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-942c1be7-d0fd-49d8-8571-38aafd025e87 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:50.805906 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-942c1be7-d0fd-49d8-8571-38aafd025e87 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.278114 Nov 16 00:31:50.806489 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 214/422] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:50 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:50.973109 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0e8715d6-64fa-4745-af00-dcd38f9c8b63 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:50.974322 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0e8715d6-64fa-4745-af00-dcd38f9c8b63 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:50.982110 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0e8715d6-64fa-4745-af00-dcd38f9c8b63 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:50.983951 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0e8715d6-64fa-4745-af00-dcd38f9c8b63 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:50.985392 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0e8715d6-64fa-4745-af00-dcd38f9c8b63 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:50.985834 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0e8715d6-64fa-4745-af00-dcd38f9c8b63 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:51.137089 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0e8715d6-64fa-4745-af00-dcd38f9c8b63 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:51.148031 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0e8715d6-64fa-4745-af00-dcd38f9c8b63 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:51.149535 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0e8715d6-64fa-4745-af00-dcd38f9c8b63 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:51.150737 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0e8715d6-64fa-4745-af00-dcd38f9c8b63 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1719 microversion: 2.20 time: 0.182659 Nov 16 00:31:51.151333 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 209/423] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:50 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:31:51.292120 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-4f2f2fa9-8ece-4196-8173-380adf075c10 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:51.292883 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-4f2f2fa9-8ece-4196-8173-380adf075c10 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:51.300244 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4f2f2fa9-8ece-4196-8173-380adf075c10 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:51.300690 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4f2f2fa9-8ece-4196-8173-380adf075c10 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:51.301499 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4f2f2fa9-8ece-4196-8173-380adf075c10 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:51.301981 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4f2f2fa9-8ece-4196-8173-380adf075c10 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:51.460379 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-4f2f2fa9-8ece-4196-8173-380adf075c10 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:51.475851 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-4f2f2fa9-8ece-4196-8173-380adf075c10 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1554 microversion: 2.1 time: 0.188093 Nov 16 00:31:51.477284 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 215/424] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:51 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1554 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:51.801033 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-44940de4-2ca2-484c-ae18-0f06ccf6ce8c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:51.802033 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-44940de4-2ca2-484c-ae18-0f06ccf6ce8c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:51.814663 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-44940de4-2ca2-484c-ae18-0f06ccf6ce8c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:51.815660 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-44940de4-2ca2-484c-ae18-0f06ccf6ce8c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:51.817700 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-44940de4-2ca2-484c-ae18-0f06ccf6ce8c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:51.820161 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-44940de4-2ca2-484c-ae18-0f06ccf6ce8c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:51.835850 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-472b7632-12a8-4fb6-8fa5-f04d084d8929 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:51.837381 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-472b7632-12a8-4fb6-8fa5-f04d084d8929 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:51.849108 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-472b7632-12a8-4fb6-8fa5-f04d084d8929 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:51.850290 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-472b7632-12a8-4fb6-8fa5-f04d084d8929 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:51.851963 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-472b7632-12a8-4fb6-8fa5-f04d084d8929 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:51.852978 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-472b7632-12a8-4fb6-8fa5-f04d084d8929 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:52.077174 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-472b7632-12a8-4fb6-8fa5-f04d084d8929 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:52.082187 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-44940de4-2ca2-484c-ae18-0f06ccf6ce8c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:52.093638 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-472b7632-12a8-4fb6-8fa5-f04d084d8929 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.263990 Nov 16 00:31:52.104796 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 216/425] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:51 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:52.105092 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-44940de4-2ca2-484c-ae18-0f06ccf6ce8c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.305789 Nov 16 00:31:52.105092 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 210/426] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:51 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:52.169896 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c3b4dcbe-6092-4a0c-90a9-4fc23b68a2b1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:52.170853 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c3b4dcbe-6092-4a0c-90a9-4fc23b68a2b1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:52.177545 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c3b4dcbe-6092-4a0c-90a9-4fc23b68a2b1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:52.178068 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c3b4dcbe-6092-4a0c-90a9-4fc23b68a2b1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:52.178954 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c3b4dcbe-6092-4a0c-90a9-4fc23b68a2b1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:52.179497 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c3b4dcbe-6092-4a0c-90a9-4fc23b68a2b1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:52.317162 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c3b4dcbe-6092-4a0c-90a9-4fc23b68a2b1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:52.327102 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c3b4dcbe-6092-4a0c-90a9-4fc23b68a2b1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:52.329093 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c3b4dcbe-6092-4a0c-90a9-4fc23b68a2b1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:52.330705 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c3b4dcbe-6092-4a0c-90a9-4fc23b68a2b1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1719 microversion: 2.20 time: 0.164595 Nov 16 00:31:52.343408 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 217/427] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:52 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:52.502923 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-8458e754-ee85-4d9e-8d5b-93909985ac80 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:52.503552 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-8458e754-ee85-4d9e-8d5b-93909985ac80 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:52.510253 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8458e754-ee85-4d9e-8d5b-93909985ac80 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:52.510748 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8458e754-ee85-4d9e-8d5b-93909985ac80 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:52.511620 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8458e754-ee85-4d9e-8d5b-93909985ac80 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:52.512091 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8458e754-ee85-4d9e-8d5b-93909985ac80 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:52.687377 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-8458e754-ee85-4d9e-8d5b-93909985ac80 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:52.695532 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-8458e754-ee85-4d9e-8d5b-93909985ac80 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1554 microversion: 2.1 time: 0.197185 Nov 16 00:31:52.696234 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 211/428] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:52 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1554 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:53.116502 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-9b8b8e2e-1b7c-4df1-9b96-d95bd4744bed tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:53.117317 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-9b8b8e2e-1b7c-4df1-9b96-d95bd4744bed tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:53.124855 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9b8b8e2e-1b7c-4df1-9b96-d95bd4744bed tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:53.125431 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9b8b8e2e-1b7c-4df1-9b96-d95bd4744bed tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:53.125930 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-09cf46c9-5047-4983-8aa2-b720bf8117c5 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:53.126434 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9b8b8e2e-1b7c-4df1-9b96-d95bd4744bed tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:53.126752 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9b8b8e2e-1b7c-4df1-9b96-d95bd4744bed tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:53.127563 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-09cf46c9-5047-4983-8aa2-b720bf8117c5 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:53.139333 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-09cf46c9-5047-4983-8aa2-b720bf8117c5 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:53.139798 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-09cf46c9-5047-4983-8aa2-b720bf8117c5 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:53.140617 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-09cf46c9-5047-4983-8aa2-b720bf8117c5 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:53.141524 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-09cf46c9-5047-4983-8aa2-b720bf8117c5 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:53.290322 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-9b8b8e2e-1b7c-4df1-9b96-d95bd4744bed tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:53.298669 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-9b8b8e2e-1b7c-4df1-9b96-d95bd4744bed tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.186774 Nov 16 00:31:53.299267 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 218/429] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:53 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:53.317549 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-09cf46c9-5047-4983-8aa2-b720bf8117c5 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:53.326460 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-09cf46c9-5047-4983-8aa2-b720bf8117c5 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.208523 Nov 16 00:31:53.327131 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 212/430] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:53 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:53.356762 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-55975b0f-ec33-4b1d-b2d4-3b87ab77517c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:53.358424 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-55975b0f-ec33-4b1d-b2d4-3b87ab77517c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:53.364279 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-55975b0f-ec33-4b1d-b2d4-3b87ab77517c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:53.364710 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-55975b0f-ec33-4b1d-b2d4-3b87ab77517c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:53.365479 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-55975b0f-ec33-4b1d-b2d4-3b87ab77517c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:53.365900 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-55975b0f-ec33-4b1d-b2d4-3b87ab77517c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:53.516123 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-55975b0f-ec33-4b1d-b2d4-3b87ab77517c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:53.527144 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-55975b0f-ec33-4b1d-b2d4-3b87ab77517c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:53.528670 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-55975b0f-ec33-4b1d-b2d4-3b87ab77517c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:53.529907 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-55975b0f-ec33-4b1d-b2d4-3b87ab77517c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1719 microversion: 2.20 time: 0.176955 Nov 16 00:31:53.530521 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 219/431] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:53 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1719 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:53.714923 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d1bdc544-bdbb-45a6-8f7b-19ea02f92ab2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:53.715497 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d1bdc544-bdbb-45a6-8f7b-19ea02f92ab2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:53.722144 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d1bdc544-bdbb-45a6-8f7b-19ea02f92ab2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:53.722567 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d1bdc544-bdbb-45a6-8f7b-19ea02f92ab2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:53.723537 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d1bdc544-bdbb-45a6-8f7b-19ea02f92ab2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:53.724086 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d1bdc544-bdbb-45a6-8f7b-19ea02f92ab2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:53.882195 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d1bdc544-bdbb-45a6-8f7b-19ea02f92ab2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:53.890185 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d1bdc544-bdbb-45a6-8f7b-19ea02f92ab2 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1554 microversion: 2.1 time: 0.179326 Nov 16 00:31:53.890740 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 213/432] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:53 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:54.318325 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f5ce0c69-9ce5-4163-a469-1f5b404dcedf tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:54.318925 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f5ce0c69-9ce5-4163-a469-1f5b404dcedf tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:54.325179 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f5ce0c69-9ce5-4163-a469-1f5b404dcedf tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:54.325612 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f5ce0c69-9ce5-4163-a469-1f5b404dcedf tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:54.326383 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f5ce0c69-9ce5-4163-a469-1f5b404dcedf tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:54.326805 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f5ce0c69-9ce5-4163-a469-1f5b404dcedf tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:54.345136 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-85394ca6-6750-4301-9a2a-1812f2b15fab tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:54.346031 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-85394ca6-6750-4301-9a2a-1812f2b15fab tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:54.352273 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-85394ca6-6750-4301-9a2a-1812f2b15fab tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:54.352715 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-85394ca6-6750-4301-9a2a-1812f2b15fab tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:54.353495 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-85394ca6-6750-4301-9a2a-1812f2b15fab tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:54.353927 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-85394ca6-6750-4301-9a2a-1812f2b15fab tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:54.514351 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-85394ca6-6750-4301-9a2a-1812f2b15fab tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:54.518264 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f5ce0c69-9ce5-4163-a469-1f5b404dcedf tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:54.524056 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-85394ca6-6750-4301-9a2a-1812f2b15fab tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.184366 Nov 16 00:31:54.530551 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 214/433] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:54 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:54.530771 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f5ce0c69-9ce5-4163-a469-1f5b404dcedf tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.211848 Nov 16 00:31:54.530771 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 220/434] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:54 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:54.548970 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f2a40dcc-bdd7-4f2e-b51b-274eb1339af6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:54.549584 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f2a40dcc-bdd7-4f2e-b51b-274eb1339af6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:54.555993 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f2a40dcc-bdd7-4f2e-b51b-274eb1339af6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:54.556439 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f2a40dcc-bdd7-4f2e-b51b-274eb1339af6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:54.557237 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f2a40dcc-bdd7-4f2e-b51b-274eb1339af6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:54.557671 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f2a40dcc-bdd7-4f2e-b51b-274eb1339af6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:54.694680 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-f2a40dcc-bdd7-4f2e-b51b-274eb1339af6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:54.704034 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-f2a40dcc-bdd7-4f2e-b51b-274eb1339af6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:54.705642 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-f2a40dcc-bdd7-4f2e-b51b-274eb1339af6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:54.706816 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-f2a40dcc-bdd7-4f2e-b51b-274eb1339af6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1719 microversion: 2.20 time: 0.161834 Nov 16 00:31:54.707600 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 215/435] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:54 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:31:54.909733 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ad68fed2-4961-4515-9989-685f60c69676 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:54.910948 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ad68fed2-4961-4515-9989-685f60c69676 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:54.921511 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ad68fed2-4961-4515-9989-685f60c69676 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:54.922311 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ad68fed2-4961-4515-9989-685f60c69676 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:54.923771 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ad68fed2-4961-4515-9989-685f60c69676 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:54.924527 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ad68fed2-4961-4515-9989-685f60c69676 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:55.286529 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-ad68fed2-4961-4515-9989-685f60c69676 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:55.300244 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ad68fed2-4961-4515-9989-685f60c69676 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1554 microversion: 2.1 time: 0.396472 Nov 16 00:31:55.301331 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 221/436] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:54 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1554 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:55.543358 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-9f89f72d-0bf8-4637-8817-d1813e398cda tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:55.544221 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-9f89f72d-0bf8-4637-8817-d1813e398cda tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:55.546713 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-493e54f1-c89b-4e72-9f40-4f5782c25b9d tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:55.549807 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-493e54f1-c89b-4e72-9f40-4f5782c25b9d tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:55.551455 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9f89f72d-0bf8-4637-8817-d1813e398cda tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:55.552008 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9f89f72d-0bf8-4637-8817-d1813e398cda tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:55.561425 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-493e54f1-c89b-4e72-9f40-4f5782c25b9d tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:55.561735 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9f89f72d-0bf8-4637-8817-d1813e398cda tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:55.562208 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9f89f72d-0bf8-4637-8817-d1813e398cda tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:55.563236 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-493e54f1-c89b-4e72-9f40-4f5782c25b9d tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:55.565739 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-493e54f1-c89b-4e72-9f40-4f5782c25b9d tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:55.566937 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-493e54f1-c89b-4e72-9f40-4f5782c25b9d tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:55.775939 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-9f89f72d-0bf8-4637-8817-d1813e398cda tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:55.785544 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-9f89f72d-0bf8-4637-8817-d1813e398cda tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.245915 Nov 16 00:31:55.795554 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 216/437] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:55 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:55.795554 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-9a3a0e43-1e48-4ff2-b6a2-dad6d5013646 req-d86f73aa-ace9-4bec-a45f-75f58bb8d0c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81", "tag": "766ca728-c4c6-4a74-b3aa-0075802cbf56"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:31:55.797268 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:31:55.797268 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:31:55.810042 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-9a3a0e43-1e48-4ff2-b6a2-dad6d5013646 req-d86f73aa-ace9-4bec-a45f-75f58bb8d0c9 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:55.810827 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-9a3a0e43-1e48-4ff2-b6a2-dad6d5013646 req-d86f73aa-ace9-4bec-a45f-75f58bb8d0c9 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:55.831092 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-9a3a0e43-1e48-4ff2-b6a2-dad6d5013646 req-d86f73aa-ace9-4bec-a45f-75f58bb8d0c9 service nova] Creating event network-changed:766ca728-c4c6-4a74-b3aa-0075802cbf56 for instance 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 on hv-cinder-81115 Nov 16 00:31:55.835848 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-9a3a0e43-1e48-4ff2-b6a2-dad6d5013646 req-d86f73aa-ace9-4bec-a45f-75f58bb8d0c9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047861 Nov 16 00:31:55.836849 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 217/438] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:31:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:31:55.842230 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-6d546a24-99c4-4f08-a968-34ab7a9d36a1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:55.842905 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-6d546a24-99c4-4f08-a968-34ab7a9d36a1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:55.850924 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6d546a24-99c4-4f08-a968-34ab7a9d36a1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:55.850924 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6d546a24-99c4-4f08-a968-34ab7a9d36a1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:55.852641 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6d546a24-99c4-4f08-a968-34ab7a9d36a1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:55.852641 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6d546a24-99c4-4f08-a968-34ab7a9d36a1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:55.996217 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-493e54f1-c89b-4e72-9f40-4f5782c25b9d tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:56.013197 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-6d546a24-99c4-4f08-a968-34ab7a9d36a1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:56.014739 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-493e54f1-c89b-4e72-9f40-4f5782c25b9d tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.474091 Nov 16 00:31:56.016186 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 222/439] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:55 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:56.026201 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-6d546a24-99c4-4f08-a968-34ab7a9d36a1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:56.027733 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-6d546a24-99c4-4f08-a968-34ab7a9d36a1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:56.028895 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-6d546a24-99c4-4f08-a968-34ab7a9d36a1 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1719 microversion: 2.20 time: 0.190766 Nov 16 00:31:56.029438 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 218/440] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:55 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1719 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:56.320493 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f4364205-7153-467d-a110-534aa0936a7a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:56.321098 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f4364205-7153-467d-a110-534aa0936a7a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:56.327386 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f4364205-7153-467d-a110-534aa0936a7a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:56.327836 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f4364205-7153-467d-a110-534aa0936a7a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:56.329350 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f4364205-7153-467d-a110-534aa0936a7a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:56.330022 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f4364205-7153-467d-a110-534aa0936a7a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:56.573358 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f4364205-7153-467d-a110-534aa0936a7a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:56.582983 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f4364205-7153-467d-a110-534aa0936a7a tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1560 microversion: 2.1 time: 0.266109 Nov 16 00:31:56.583582 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 223/441] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:56 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1560 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:56.804469 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-292d43d9-ce2a-4a03-a941-7c0bdabc1c8d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:56.805174 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-292d43d9-ce2a-4a03-a941-7c0bdabc1c8d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:56.811559 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-292d43d9-ce2a-4a03-a941-7c0bdabc1c8d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:56.812098 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-292d43d9-ce2a-4a03-a941-7c0bdabc1c8d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:56.813194 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-292d43d9-ce2a-4a03-a941-7c0bdabc1c8d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:56.813822 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-292d43d9-ce2a-4a03-a941-7c0bdabc1c8d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:56.836265 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f6b34f22-b8fd-4cdb-ba08-f06c54673c2f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:56.837069 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f6b34f22-b8fd-4cdb-ba08-f06c54673c2f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:56.844807 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f6b34f22-b8fd-4cdb-ba08-f06c54673c2f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:56.845481 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f6b34f22-b8fd-4cdb-ba08-f06c54673c2f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:56.846260 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f6b34f22-b8fd-4cdb-ba08-f06c54673c2f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:56.846881 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f6b34f22-b8fd-4cdb-ba08-f06c54673c2f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:56.948545 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.objects.instance [None req-f6b34f22-b8fd-4cdb-ba08-f06c54673c2f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lazy-loading 'services' on Instance uuid 896600e3-829b-43f9-87af-60d271f05432 {{(pid=122543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:31:56.981832 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-292d43d9-ce2a-4a03-a941-7c0bdabc1c8d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:56.990217 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-292d43d9-ce2a-4a03-a941-7c0bdabc1c8d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.190549 Nov 16 00:31:56.994454 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 219/442] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:56 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:57.041886 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-467f42e7-8417-4cae-9f1d-ac5c15e42824 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:57.042495 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-467f42e7-8417-4cae-9f1d-ac5c15e42824 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:57.049409 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-467f42e7-8417-4cae-9f1d-ac5c15e42824 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:57.049853 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-467f42e7-8417-4cae-9f1d-ac5c15e42824 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:57.050626 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-467f42e7-8417-4cae-9f1d-ac5c15e42824 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:57.051265 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-467f42e7-8417-4cae-9f1d-ac5c15e42824 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:57.081418 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f6b34f22-b8fd-4cdb-ba08-f06c54673c2f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "DELETE /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432/os-volume_attachments/6a7c049b-a455-4d52-a3d5-d00dd6d196a3" status: 202 len: 0 microversion: 2.1 time: 0.250037 Nov 16 00:31:57.082113 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 224/443] 10.222.0.31 () {58 vars in 1415 bytes} [Tue Nov 16 00:31:56 2021] DELETE /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432/os-volume_attachments/6a7c049b-a455-4d52-a3d5-d00dd6d196a3 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:31:57.087908 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-92f9b890-a502-471a-a7c0-ddddd33e09d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:57.089133 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-92f9b890-a502-471a-a7c0-ddddd33e09d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:57.098272 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-92f9b890-a502-471a-a7c0-ddddd33e09d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:57.098700 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-92f9b890-a502-471a-a7c0-ddddd33e09d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:57.099491 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-92f9b890-a502-471a-a7c0-ddddd33e09d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:57.099921 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-92f9b890-a502-471a-a7c0-ddddd33e09d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:57.207736 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-467f42e7-8417-4cae-9f1d-ac5c15e42824 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:57.217808 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-467f42e7-8417-4cae-9f1d-ac5c15e42824 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.179646 Nov 16 00:31:57.218510 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 220/444] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:57 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:57.236015 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-74a101cb-859c-43d9-b948-2a4fb5e01ee5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:57.236996 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-74a101cb-859c-43d9-b948-2a4fb5e01ee5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:57.244481 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-74a101cb-859c-43d9-b948-2a4fb5e01ee5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:57.245117 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-74a101cb-859c-43d9-b948-2a4fb5e01ee5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:57.246383 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-74a101cb-859c-43d9-b948-2a4fb5e01ee5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:57.246963 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-74a101cb-859c-43d9-b948-2a4fb5e01ee5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:57.280015 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-74a101cb-859c-43d9-b948-2a4fb5e01ee5 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048805 Nov 16 00:31:57.280929 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 221/445] 10.222.0.31 () {58 vars in 1301 bytes} [Tue Nov 16 00:31:57 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:31:57.295145 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-92f9b890-a502-471a-a7c0-ddddd33e09d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:57.304667 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-92f9b890-a502-471a-a7c0-ddddd33e09d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:57.306159 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-92f9b890-a502-471a-a7c0-ddddd33e09d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:57.307366 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-92f9b890-a502-471a-a7c0-ddddd33e09d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1662 microversion: 2.20 time: 0.223673 Nov 16 00:31:57.307934 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 225/446] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:57 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1662 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:57.325410 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-036bfe6e-7032-4195-bc4a-240f0a40096a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5dfe14b9-8ca2-49c8-8bc8-d03cd63e6439"}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:31:57.326466 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-036bfe6e-7032-4195-bc4a-240f0a40096a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:57.332632 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-036bfe6e-7032-4195-bc4a-240f0a40096a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:57.333078 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-036bfe6e-7032-4195-bc4a-240f0a40096a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:57.333857 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-036bfe6e-7032-4195-bc4a-240f0a40096a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:57.334286 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-036bfe6e-7032-4195-bc4a-240f0a40096a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:57.630623 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-036bfe6e-7032-4195-bc4a-240f0a40096a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.308987 Nov 16 00:31:57.631582 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 222/447] 10.222.0.31 () {62 vars in 1363 bytes} [Tue Nov 16 00:31:57 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/os-volume_attachments => generated 188 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:31:57.780386 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-6f110e7f-2059-4254-b2af-968bb0447151 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:31:57.780953 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-6f110e7f-2059-4254-b2af-968bb0447151 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:57.787492 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6f110e7f-2059-4254-b2af-968bb0447151 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:57.788244 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6f110e7f-2059-4254-b2af-968bb0447151 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:57.789031 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6f110e7f-2059-4254-b2af-968bb0447151 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:57.789460 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6f110e7f-2059-4254-b2af-968bb0447151 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:57.893857 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-6f110e7f-2059-4254-b2af-968bb0447151 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action" status: 202 len: 0 microversion: 2.20 time: 0.117171 Nov 16 00:31:57.894469 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 226/448] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:31:57 2021] POST /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 16 00:31:57.904178 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-9c86947a-a500-4d0b-b9d0-13216c906733 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:57.904798 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-9c86947a-a500-4d0b-b9d0-13216c906733 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:57.912506 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9c86947a-a500-4d0b-b9d0-13216c906733 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:57.913326 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9c86947a-a500-4d0b-b9d0-13216c906733 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:57.914196 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9c86947a-a500-4d0b-b9d0-13216c906733 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:57.914686 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9c86947a-a500-4d0b-b9d0-13216c906733 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:58.018194 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f63ae1d5-51ca-4881-9f08-86f5a973277d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:58.019297 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f63ae1d5-51ca-4881-9f08-86f5a973277d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:58.030891 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f63ae1d5-51ca-4881-9f08-86f5a973277d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:58.032948 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f63ae1d5-51ca-4881-9f08-86f5a973277d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:58.034672 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f63ae1d5-51ca-4881-9f08-86f5a973277d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:58.036478 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f63ae1d5-51ca-4881-9f08-86f5a973277d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:58.098831 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-9c86947a-a500-4d0b-b9d0-13216c906733 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:58.107974 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-9c86947a-a500-4d0b-b9d0-13216c906733 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:58.109541 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-9c86947a-a500-4d0b-b9d0-13216c906733 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:58.110774 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-9c86947a-a500-4d0b-b9d0-13216c906733 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1748 microversion: 2.20 time: 0.211659 Nov 16 00:31:58.111548 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 223/449] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:57 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1748 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:58.229829 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f63ae1d5-51ca-4881-9f08-86f5a973277d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:58.237466 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-01335f77-e617-49b6-99bf-dd37bcec6528 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:58.238071 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-01335f77-e617-49b6-99bf-dd37bcec6528 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:58.238227 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f63ae1d5-51ca-4881-9f08-86f5a973277d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.227658 Nov 16 00:31:58.239033 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 227/450] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:58 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:31:58.244566 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-01335f77-e617-49b6-99bf-dd37bcec6528 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:58.244999 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-01335f77-e617-49b6-99bf-dd37bcec6528 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:58.245777 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-01335f77-e617-49b6-99bf-dd37bcec6528 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:58.246215 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-01335f77-e617-49b6-99bf-dd37bcec6528 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:58.293221 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-200eeec6-7835-4e93-8492-0cbc17d41a2c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:58.294194 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-200eeec6-7835-4e93-8492-0cbc17d41a2c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:58.301863 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-200eeec6-7835-4e93-8492-0cbc17d41a2c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:58.302311 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-200eeec6-7835-4e93-8492-0cbc17d41a2c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:58.303120 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-200eeec6-7835-4e93-8492-0cbc17d41a2c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:58.312278 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-200eeec6-7835-4e93-8492-0cbc17d41a2c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:58.347102 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-200eeec6-7835-4e93-8492-0cbc17d41a2c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057340 Nov 16 00:31:58.347728 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 228/451] 10.222.0.31 () {58 vars in 1301 bytes} [Tue Nov 16 00:31:58 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:31:58.426848 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-01335f77-e617-49b6-99bf-dd37bcec6528 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:58.435263 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-01335f77-e617-49b6-99bf-dd37bcec6528 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.203301 Nov 16 00:31:58.435940 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 224/452] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:58 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:59.131688 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-aebad1f4-ff69-4879-b45f-e362626a5480 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:59.132369 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-aebad1f4-ff69-4879-b45f-e362626a5480 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:59.138719 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-aebad1f4-ff69-4879-b45f-e362626a5480 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:59.139200 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-aebad1f4-ff69-4879-b45f-e362626a5480 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:59.140004 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-aebad1f4-ff69-4879-b45f-e362626a5480 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:59.140472 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-aebad1f4-ff69-4879-b45f-e362626a5480 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:59.267400 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-9d20a961-bba9-47b9-8e7a-483934d51d9d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:59.268535 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-9d20a961-bba9-47b9-8e7a-483934d51d9d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:59.276573 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9d20a961-bba9-47b9-8e7a-483934d51d9d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:59.277113 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9d20a961-bba9-47b9-8e7a-483934d51d9d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:59.277969 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9d20a961-bba9-47b9-8e7a-483934d51d9d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:59.278480 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9d20a961-bba9-47b9-8e7a-483934d51d9d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:59.322022 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-aebad1f4-ff69-4879-b45f-e362626a5480 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:59.334379 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-aebad1f4-ff69-4879-b45f-e362626a5480 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:59.335937 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-aebad1f4-ff69-4879-b45f-e362626a5480 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:59.337174 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-aebad1f4-ff69-4879-b45f-e362626a5480 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1750 microversion: 2.20 time: 0.209337 Nov 16 00:31:59.337741 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 229/453] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:31:59 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1750 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:31:59.453309 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-9d20a961-bba9-47b9-8e7a-483934d51d9d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:59.454108 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-24a79e9f-8e8b-486e-a3b8-ac63cbb613bb tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:31:59.454716 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-24a79e9f-8e8b-486e-a3b8-ac63cbb613bb tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:31:59.460849 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-9d20a961-bba9-47b9-8e7a-483934d51d9d tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.206776 Nov 16 00:31:59.461439 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 225/454] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:59 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:31:59.467607 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-24a79e9f-8e8b-486e-a3b8-ac63cbb613bb tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:59.467607 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-24a79e9f-8e8b-486e-a3b8-ac63cbb613bb tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:59.467607 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-24a79e9f-8e8b-486e-a3b8-ac63cbb613bb tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:31:59.467607 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-24a79e9f-8e8b-486e-a3b8-ac63cbb613bb tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:31:59.615990 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-24a79e9f-8e8b-486e-a3b8-ac63cbb613bb tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:31:59.624670 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-24a79e9f-8e8b-486e-a3b8-ac63cbb613bb tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.176139 Nov 16 00:31:59.625594 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 230/455] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:31:59 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:00.358628 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-919ac2ba-29f9-4acd-a8af-1f3e2c6c8e6f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:00.359260 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-919ac2ba-29f9-4acd-a8af-1f3e2c6c8e6f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:00.365417 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-919ac2ba-29f9-4acd-a8af-1f3e2c6c8e6f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:00.365815 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-919ac2ba-29f9-4acd-a8af-1f3e2c6c8e6f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:00.366582 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-919ac2ba-29f9-4acd-a8af-1f3e2c6c8e6f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:00.367006 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-919ac2ba-29f9-4acd-a8af-1f3e2c6c8e6f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:00.477580 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-5a92fa90-1754-411b-8555-716337944736 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:00.478360 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-5a92fa90-1754-411b-8555-716337944736 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:00.485277 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5a92fa90-1754-411b-8555-716337944736 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:00.485727 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5a92fa90-1754-411b-8555-716337944736 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:00.486568 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5a92fa90-1754-411b-8555-716337944736 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:00.487238 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5a92fa90-1754-411b-8555-716337944736 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:00.498543 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-919ac2ba-29f9-4acd-a8af-1f3e2c6c8e6f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:00.508447 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-919ac2ba-29f9-4acd-a8af-1f3e2c6c8e6f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:00.510101 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-919ac2ba-29f9-4acd-a8af-1f3e2c6c8e6f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:00.511475 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-919ac2ba-29f9-4acd-a8af-1f3e2c6c8e6f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.156538 Nov 16 00:32:00.512039 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 226/456] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:00 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:32:00.641638 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-43eff4d5-5f3c-4e6a-b344-b1a8cf839bc0 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:00.642265 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-43eff4d5-5f3c-4e6a-b344-b1a8cf839bc0 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:00.649127 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-43eff4d5-5f3c-4e6a-b344-b1a8cf839bc0 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:00.649539 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-43eff4d5-5f3c-4e6a-b344-b1a8cf839bc0 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:00.650504 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-43eff4d5-5f3c-4e6a-b344-b1a8cf839bc0 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:00.651109 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-43eff4d5-5f3c-4e6a-b344-b1a8cf839bc0 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:00.703890 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-5a92fa90-1754-411b-8555-716337944736 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:00.716690 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-5a92fa90-1754-411b-8555-716337944736 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.242544 Nov 16 00:32:00.728682 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 231/457] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:00 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:00.773900 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-a112436f-7a8c-4ded-984e-54e345dc14fb tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:00.774797 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-a112436f-7a8c-4ded-984e-54e345dc14fb tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:00.781482 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a112436f-7a8c-4ded-984e-54e345dc14fb tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:00.781832 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a112436f-7a8c-4ded-984e-54e345dc14fb tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:00.783028 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a112436f-7a8c-4ded-984e-54e345dc14fb tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:00.783654 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a112436f-7a8c-4ded-984e-54e345dc14fb tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:00.807581 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-43eff4d5-5f3c-4e6a-b344-b1a8cf839bc0 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:00.818840 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-a112436f-7a8c-4ded-984e-54e345dc14fb tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Going to try to terminate instance {{(pid=122543) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:32:00.823509 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-43eff4d5-5f3c-4e6a-b344-b1a8cf839bc0 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.185533 Nov 16 00:32:00.824671 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 227/458] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:00 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:00.925816 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-a112436f-7a8c-4ded-984e-54e345dc14fb tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 204 len: 0 microversion: 2.1 time: 0.155408 Nov 16 00:32:00.926408 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 232/459] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:32:00 2021] DELETE /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 00:32:00.934955 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-5e468c8c-2b65-4312-b54d-f340d3bc34a1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:00.935814 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-5e468c8c-2b65-4312-b54d-f340d3bc34a1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:00.942173 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5e468c8c-2b65-4312-b54d-f340d3bc34a1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:00.942618 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5e468c8c-2b65-4312-b54d-f340d3bc34a1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:00.943464 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5e468c8c-2b65-4312-b54d-f340d3bc34a1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:00.943878 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5e468c8c-2b65-4312-b54d-f340d3bc34a1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:01.078846 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-5e468c8c-2b65-4312-b54d-f340d3bc34a1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:01.086492 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-5e468c8c-2b65-4312-b54d-f340d3bc34a1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1507 microversion: 2.1 time: 0.155785 Nov 16 00:32:01.087086 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 228/460] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:00 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:01.536684 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-a5baf3cd-20e4-497b-a74a-39acfb3e1de0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:01.538735 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-a5baf3cd-20e4-497b-a74a-39acfb3e1de0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:01.548005 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a5baf3cd-20e4-497b-a74a-39acfb3e1de0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:01.549059 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a5baf3cd-20e4-497b-a74a-39acfb3e1de0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:01.550176 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a5baf3cd-20e4-497b-a74a-39acfb3e1de0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:01.551234 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a5baf3cd-20e4-497b-a74a-39acfb3e1de0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:01.735665 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-28fb3066-133e-4fbf-b035-b7f0c554569a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:01.736442 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-28fb3066-133e-4fbf-b035-b7f0c554569a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:01.757965 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-28fb3066-133e-4fbf-b035-b7f0c554569a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:01.758421 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-28fb3066-133e-4fbf-b035-b7f0c554569a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:01.759257 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-28fb3066-133e-4fbf-b035-b7f0c554569a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:01.759693 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-28fb3066-133e-4fbf-b035-b7f0c554569a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:01.785791 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-a5baf3cd-20e4-497b-a74a-39acfb3e1de0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:01.811752 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-a5baf3cd-20e4-497b-a74a-39acfb3e1de0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:01.814129 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-a5baf3cd-20e4-497b-a74a-39acfb3e1de0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:01.815517 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-a5baf3cd-20e4-497b-a74a-39acfb3e1de0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.285874 Nov 16 00:32:01.816332 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 233/461] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:01 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:32:01.841843 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8b0fe189-9831-4b7e-a636-1b07a05d76d7 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:01.842724 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8b0fe189-9831-4b7e-a636-1b07a05d76d7 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:01.851522 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8b0fe189-9831-4b7e-a636-1b07a05d76d7 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:01.852573 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8b0fe189-9831-4b7e-a636-1b07a05d76d7 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:01.853801 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8b0fe189-9831-4b7e-a636-1b07a05d76d7 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:01.854540 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8b0fe189-9831-4b7e-a636-1b07a05d76d7 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:02.082496 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-8b0fe189-9831-4b7e-a636-1b07a05d76d7 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:02.092371 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8b0fe189-9831-4b7e-a636-1b07a05d76d7 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.254202 Nov 16 00:32:02.099247 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-28fb3066-133e-4fbf-b035-b7f0c554569a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:02.107511 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 234/462] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:01 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:02.112290 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-28fb3066-133e-4fbf-b035-b7f0c554569a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.379965 Nov 16 00:32:02.113504 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 229/463] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:01 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:02.115565 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-9e4d2dfa-5f26-4b41-ab89-285401b20057 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:02.116559 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-9e4d2dfa-5f26-4b41-ab89-285401b20057 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:02.129603 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9e4d2dfa-5f26-4b41-ab89-285401b20057 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:02.130182 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9e4d2dfa-5f26-4b41-ab89-285401b20057 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:02.130751 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9e4d2dfa-5f26-4b41-ab89-285401b20057 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:02.131250 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9e4d2dfa-5f26-4b41-ab89-285401b20057 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:02.135296 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-44b05f86-1c97-49ab-b412-7a2f67510d35 req-4b3e56bd-2497-40d8-98fe-8872f0f31a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81", "name": "network-vif-plugged", "status": "completed", "tag": "766ca728-c4c6-4a74-b3aa-0075802cbf56"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:32:02.136900 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:32:02.136900 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:32:02.145075 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-44b05f86-1c97-49ab-b412-7a2f67510d35 req-4b3e56bd-2497-40d8-98fe-8872f0f31a43 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:02.145797 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-44b05f86-1c97-49ab-b412-7a2f67510d35 req-4b3e56bd-2497-40d8-98fe-8872f0f31a43 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:02.160677 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-44b05f86-1c97-49ab-b412-7a2f67510d35 req-4b3e56bd-2497-40d8-98fe-8872f0f31a43 service nova] Creating event network-vif-plugged:766ca728-c4c6-4a74-b3aa-0075802cbf56 for instance 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 on hv-cinder-81115 Nov 16 00:32:02.167285 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-44b05f86-1c97-49ab-b412-7a2f67510d35 req-4b3e56bd-2497-40d8-98fe-8872f0f31a43 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035619 Nov 16 00:32:02.169682 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 230/464] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:32:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:32:02.367369 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-9e4d2dfa-5f26-4b41-ab89-285401b20057 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:02.392010 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-9e4d2dfa-5f26-4b41-ab89-285401b20057 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1507 microversion: 2.1 time: 0.282616 Nov 16 00:32:02.392664 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 235/465] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:02 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1507 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:02.841142 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f483cfba-7f70-44ed-951b-27c220b68653 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:02.842739 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f483cfba-7f70-44ed-951b-27c220b68653 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:02.852068 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f483cfba-7f70-44ed-951b-27c220b68653 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:02.852622 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f483cfba-7f70-44ed-951b-27c220b68653 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:02.853522 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f483cfba-7f70-44ed-951b-27c220b68653 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:02.854033 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f483cfba-7f70-44ed-951b-27c220b68653 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:03.037898 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-f483cfba-7f70-44ed-951b-27c220b68653 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:03.054719 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-f483cfba-7f70-44ed-951b-27c220b68653 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:03.058065 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-f483cfba-7f70-44ed-951b-27c220b68653 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:03.060730 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-f483cfba-7f70-44ed-951b-27c220b68653 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.227364 Nov 16 00:32:03.062111 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 231/466] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:02 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:32:03.118917 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ffe10dcd-2c16-4d8f-bf8e-8eada2b154f9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:03.120105 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ffe10dcd-2c16-4d8f-bf8e-8eada2b154f9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:03.136645 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0917cfb1-f297-41aa-91bb-9435a3f04a58 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:03.137718 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0917cfb1-f297-41aa-91bb-9435a3f04a58 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:03.141911 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ffe10dcd-2c16-4d8f-bf8e-8eada2b154f9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:03.142589 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ffe10dcd-2c16-4d8f-bf8e-8eada2b154f9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:03.143947 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ffe10dcd-2c16-4d8f-bf8e-8eada2b154f9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:03.144716 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ffe10dcd-2c16-4d8f-bf8e-8eada2b154f9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:03.145873 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0917cfb1-f297-41aa-91bb-9435a3f04a58 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:03.146461 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0917cfb1-f297-41aa-91bb-9435a3f04a58 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:03.147420 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0917cfb1-f297-41aa-91bb-9435a3f04a58 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:03.147936 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0917cfb1-f297-41aa-91bb-9435a3f04a58 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:03.336339 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0917cfb1-f297-41aa-91bb-9435a3f04a58 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:03.336581 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-ffe10dcd-2c16-4d8f-bf8e-8eada2b154f9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:03.346127 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ffe10dcd-2c16-4d8f-bf8e-8eada2b154f9 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.234090 Nov 16 00:32:03.346724 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 236/467] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:03 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:03.347006 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0917cfb1-f297-41aa-91bb-9435a3f04a58 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.217530 Nov 16 00:32:03.347604 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 232/468] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:03 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:03.415141 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c193e44a-ccfe-432d-8d3e-e0c983cf2361 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:03.416393 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c193e44a-ccfe-432d-8d3e-e0c983cf2361 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:03.427599 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c193e44a-ccfe-432d-8d3e-e0c983cf2361 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:03.428403 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c193e44a-ccfe-432d-8d3e-e0c983cf2361 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:03.429896 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c193e44a-ccfe-432d-8d3e-e0c983cf2361 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:03.430700 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c193e44a-ccfe-432d-8d3e-e0c983cf2361 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:03.595370 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c193e44a-ccfe-432d-8d3e-e0c983cf2361 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:03.603407 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c193e44a-ccfe-432d-8d3e-e0c983cf2361 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1507 microversion: 2.1 time: 0.196158 Nov 16 00:32:03.603987 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 237/469] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:03 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1507 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:04.089979 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-b0ff9de5-ebb9-4a8c-9b87-ecf01d1b14dc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:04.090749 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-b0ff9de5-ebb9-4a8c-9b87-ecf01d1b14dc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:04.097857 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b0ff9de5-ebb9-4a8c-9b87-ecf01d1b14dc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:04.098298 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b0ff9de5-ebb9-4a8c-9b87-ecf01d1b14dc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:04.099157 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b0ff9de5-ebb9-4a8c-9b87-ecf01d1b14dc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:04.099593 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b0ff9de5-ebb9-4a8c-9b87-ecf01d1b14dc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:04.210186 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-9aee74ec-cb1b-40a8-92a5-432da900d0cd req-19ca5f23-c348-4986-a11d-5907efa112db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44cd98fe-3bda-4129-a9d1-ad922d5c3d10", "name": "network-vif-plugged", "status": "completed", "tag": "b6e9163c-8268-4e52-8726-8961a776e608"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:32:04.211880 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:32:04.211880 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:32:04.232333 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-9aee74ec-cb1b-40a8-92a5-432da900d0cd req-19ca5f23-c348-4986-a11d-5907efa112db service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:04.232765 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-9aee74ec-cb1b-40a8-92a5-432da900d0cd req-19ca5f23-c348-4986-a11d-5907efa112db service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:04.233094 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-b0ff9de5-ebb9-4a8c-9b87-ecf01d1b14dc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:04.242881 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-b0ff9de5-ebb9-4a8c-9b87-ecf01d1b14dc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:04.244404 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-b0ff9de5-ebb9-4a8c-9b87-ecf01d1b14dc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:04.245585 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-b0ff9de5-ebb9-4a8c-9b87-ecf01d1b14dc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.159567 Nov 16 00:32:04.246530 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 233/470] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:04 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:32:04.249861 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-9aee74ec-cb1b-40a8-92a5-432da900d0cd req-19ca5f23-c348-4986-a11d-5907efa112db service nova] Creating event network-vif-plugged:b6e9163c-8268-4e52-8726-8961a776e608 for instance 44cd98fe-3bda-4129-a9d1-ad922d5c3d10 on hv-cinder-81115 Nov 16 00:32:04.259827 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-9aee74ec-cb1b-40a8-92a5-432da900d0cd req-19ca5f23-c348-4986-a11d-5907efa112db service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052996 Nov 16 00:32:04.260425 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 238/471] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:32:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:32:04.365879 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-9b3cb605-8199-41fa-b6b9-b9faff3e3d52 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:04.366847 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-9b3cb605-8199-41fa-b6b9-b9faff3e3d52 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:04.376068 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9b3cb605-8199-41fa-b6b9-b9faff3e3d52 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:04.378858 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9b3cb605-8199-41fa-b6b9-b9faff3e3d52 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:04.378858 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9b3cb605-8199-41fa-b6b9-b9faff3e3d52 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:04.379228 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-6e51c430-82f8-46cb-8bf0-2ec59ba0ba96 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:04.379484 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9b3cb605-8199-41fa-b6b9-b9faff3e3d52 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:04.379586 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-6e51c430-82f8-46cb-8bf0-2ec59ba0ba96 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:04.390534 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6e51c430-82f8-46cb-8bf0-2ec59ba0ba96 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:04.391597 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6e51c430-82f8-46cb-8bf0-2ec59ba0ba96 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:04.393205 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6e51c430-82f8-46cb-8bf0-2ec59ba0ba96 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:04.394121 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6e51c430-82f8-46cb-8bf0-2ec59ba0ba96 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:04.524595 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-9b3cb605-8199-41fa-b6b9-b9faff3e3d52 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:04.538292 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-9b3cb605-8199-41fa-b6b9-b9faff3e3d52 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.175702 Nov 16 00:32:04.539367 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 234/472] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:04 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:04.557915 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-6e51c430-82f8-46cb-8bf0-2ec59ba0ba96 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:04.570641 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-6e51c430-82f8-46cb-8bf0-2ec59ba0ba96 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.200743 Nov 16 00:32:04.571687 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 239/473] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:04 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:04.620850 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-019207c7-edca-4f67-9c0e-26ef952c2590 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:04.621496 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-019207c7-edca-4f67-9c0e-26ef952c2590 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:04.628630 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-019207c7-edca-4f67-9c0e-26ef952c2590 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:04.629070 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-019207c7-edca-4f67-9c0e-26ef952c2590 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:04.629843 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-019207c7-edca-4f67-9c0e-26ef952c2590 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:04.630279 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-019207c7-edca-4f67-9c0e-26ef952c2590 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:04.825185 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-019207c7-edca-4f67-9c0e-26ef952c2590 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:04.839898 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-019207c7-edca-4f67-9c0e-26ef952c2590 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1507 microversion: 2.1 time: 0.222078 Nov 16 00:32:04.841325 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 235/474] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:04 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1507 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:05.266045 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-fae55a57-74fd-4ee1-bb64-6bf2c7dc7e92 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:05.266862 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-fae55a57-74fd-4ee1-bb64-6bf2c7dc7e92 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:05.273310 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fae55a57-74fd-4ee1-bb64-6bf2c7dc7e92 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:05.273795 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fae55a57-74fd-4ee1-bb64-6bf2c7dc7e92 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:05.274609 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fae55a57-74fd-4ee1-bb64-6bf2c7dc7e92 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:05.275040 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fae55a57-74fd-4ee1-bb64-6bf2c7dc7e92 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:05.415717 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-fae55a57-74fd-4ee1-bb64-6bf2c7dc7e92 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:05.425648 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-fae55a57-74fd-4ee1-bb64-6bf2c7dc7e92 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:05.427378 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-fae55a57-74fd-4ee1-bb64-6bf2c7dc7e92 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:05.428601 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-fae55a57-74fd-4ee1-bb64-6bf2c7dc7e92 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.167098 Nov 16 00:32:05.429383 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 240/475] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:05 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:32:05.556046 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-cb4e0123-2ddd-4e75-88a5-811a66b41377 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:05.556907 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-cb4e0123-2ddd-4e75-88a5-811a66b41377 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:05.563157 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cb4e0123-2ddd-4e75-88a5-811a66b41377 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:05.563606 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cb4e0123-2ddd-4e75-88a5-811a66b41377 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:05.564381 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cb4e0123-2ddd-4e75-88a5-811a66b41377 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:05.564812 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cb4e0123-2ddd-4e75-88a5-811a66b41377 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:05.587659 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8f92cd38-e64b-4088-aa55-5ffbcb468a57 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:05.588332 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8f92cd38-e64b-4088-aa55-5ffbcb468a57 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:05.594772 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8f92cd38-e64b-4088-aa55-5ffbcb468a57 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:05.595247 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8f92cd38-e64b-4088-aa55-5ffbcb468a57 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:05.596119 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8f92cd38-e64b-4088-aa55-5ffbcb468a57 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:05.596571 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8f92cd38-e64b-4088-aa55-5ffbcb468a57 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:05.719459 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-cb4e0123-2ddd-4e75-88a5-811a66b41377 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:05.728598 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-cb4e0123-2ddd-4e75-88a5-811a66b41377 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.176146 Nov 16 00:32:05.741232 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 236/476] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:05 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:05.773292 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-8f92cd38-e64b-4088-aa55-5ffbcb468a57 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:05.782154 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8f92cd38-e64b-4088-aa55-5ffbcb468a57 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.197955 Nov 16 00:32:05.783025 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 241/477] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:05 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:05.870052 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-5c2a40ad-b7d9-4481-b889-8ecbb6fe3011 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:05.870836 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-5c2a40ad-b7d9-4481-b889-8ecbb6fe3011 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:05.877826 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5c2a40ad-b7d9-4481-b889-8ecbb6fe3011 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:05.878273 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5c2a40ad-b7d9-4481-b889-8ecbb6fe3011 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:05.879126 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5c2a40ad-b7d9-4481-b889-8ecbb6fe3011 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:05.879564 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5c2a40ad-b7d9-4481-b889-8ecbb6fe3011 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:06.012174 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-5c2a40ad-b7d9-4481-b889-8ecbb6fe3011 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:06.021799 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-5c2a40ad-b7d9-4481-b889-8ecbb6fe3011 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1507 microversion: 2.1 time: 0.155814 Nov 16 00:32:06.031216 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 237/478] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:05 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:06.447906 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-4145034f-95e2-4b47-b4a1-7677c443baf3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:06.448601 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-4145034f-95e2-4b47-b4a1-7677c443baf3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:06.455715 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4145034f-95e2-4b47-b4a1-7677c443baf3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:06.456149 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4145034f-95e2-4b47-b4a1-7677c443baf3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:06.457041 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4145034f-95e2-4b47-b4a1-7677c443baf3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:06.457467 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4145034f-95e2-4b47-b4a1-7677c443baf3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:06.598535 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-4145034f-95e2-4b47-b4a1-7677c443baf3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:06.607534 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-4145034f-95e2-4b47-b4a1-7677c443baf3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:06.609128 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-4145034f-95e2-4b47-b4a1-7677c443baf3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:06.610752 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-4145034f-95e2-4b47-b4a1-7677c443baf3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.166360 Nov 16 00:32:06.611394 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 242/479] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:06 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:32:06.749063 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-4926df53-356e-44a6-a82f-dbe071b7b3f2 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:06.749690 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-4926df53-356e-44a6-a82f-dbe071b7b3f2 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:06.757207 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4926df53-356e-44a6-a82f-dbe071b7b3f2 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:06.758012 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4926df53-356e-44a6-a82f-dbe071b7b3f2 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:06.758433 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4926df53-356e-44a6-a82f-dbe071b7b3f2 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:06.758864 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4926df53-356e-44a6-a82f-dbe071b7b3f2 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:06.799707 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-940ff53f-62a8-47ba-b38e-9ed419aa7906 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:06.800712 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-940ff53f-62a8-47ba-b38e-9ed419aa7906 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:06.807463 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-940ff53f-62a8-47ba-b38e-9ed419aa7906 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:06.807980 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-940ff53f-62a8-47ba-b38e-9ed419aa7906 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:06.808882 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-940ff53f-62a8-47ba-b38e-9ed419aa7906 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:06.809330 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-940ff53f-62a8-47ba-b38e-9ed419aa7906 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:06.898346 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-4926df53-356e-44a6-a82f-dbe071b7b3f2 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:06.906935 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-4926df53-356e-44a6-a82f-dbe071b7b3f2 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.161131 Nov 16 00:32:06.907781 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 238/480] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:06 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:06.949135 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-940ff53f-62a8-47ba-b38e-9ed419aa7906 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:06.957453 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-940ff53f-62a8-47ba-b38e-9ed419aa7906 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.161376 Nov 16 00:32:06.958012 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 243/481] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:06 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:07.039101 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-569bf0df-dd59-4489-8298-004afe4c8156 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:07.039699 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-569bf0df-dd59-4489-8298-004afe4c8156 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:07.046931 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-569bf0df-dd59-4489-8298-004afe4c8156 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:07.047453 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-569bf0df-dd59-4489-8298-004afe4c8156 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:07.048339 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-569bf0df-dd59-4489-8298-004afe4c8156 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:07.048772 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-569bf0df-dd59-4489-8298-004afe4c8156 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:07.186915 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-569bf0df-dd59-4489-8298-004afe4c8156 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:07.194954 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-569bf0df-dd59-4489-8298-004afe4c8156 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1507 microversion: 2.1 time: 0.159791 Nov 16 00:32:07.195559 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 239/482] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:07 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:07.632721 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-2e1c13e5-1ef4-47e2-b828-d4bdad028842 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:07.633780 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-2e1c13e5-1ef4-47e2-b828-d4bdad028842 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:07.642943 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2e1c13e5-1ef4-47e2-b828-d4bdad028842 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:07.643818 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2e1c13e5-1ef4-47e2-b828-d4bdad028842 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:07.645105 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2e1c13e5-1ef4-47e2-b828-d4bdad028842 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:07.645563 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2e1c13e5-1ef4-47e2-b828-d4bdad028842 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:07.816333 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2e1c13e5-1ef4-47e2-b828-d4bdad028842 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:07.834429 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2e1c13e5-1ef4-47e2-b828-d4bdad028842 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:07.837549 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2e1c13e5-1ef4-47e2-b828-d4bdad028842 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:07.840008 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-2e1c13e5-1ef4-47e2-b828-d4bdad028842 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.212071 Nov 16 00:32:07.841125 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 244/483] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:07 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:32:07.924632 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-594e9564-347d-47d3-b4fa-5a5247eea4a2 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:07.925308 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-594e9564-347d-47d3-b4fa-5a5247eea4a2 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:07.931308 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-594e9564-347d-47d3-b4fa-5a5247eea4a2 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:07.931754 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-594e9564-347d-47d3-b4fa-5a5247eea4a2 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:07.932534 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-594e9564-347d-47d3-b4fa-5a5247eea4a2 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:07.932966 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-594e9564-347d-47d3-b4fa-5a5247eea4a2 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:07.974371 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-e08c8df1-765d-49b4-bc8c-f224b08aab91 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:07.974980 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-e08c8df1-765d-49b4-bc8c-f224b08aab91 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:07.981108 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e08c8df1-765d-49b4-bc8c-f224b08aab91 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:07.981555 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e08c8df1-765d-49b4-bc8c-f224b08aab91 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:07.982338 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e08c8df1-765d-49b4-bc8c-f224b08aab91 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:07.982771 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e08c8df1-765d-49b4-bc8c-f224b08aab91 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:08.100935 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-594e9564-347d-47d3-b4fa-5a5247eea4a2 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:08.109074 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-594e9564-347d-47d3-b4fa-5a5247eea4a2 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.189210 Nov 16 00:32:08.109676 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 240/484] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:07 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:08.123407 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e08c8df1-765d-49b4-bc8c-f224b08aab91 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:08.131001 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-e08c8df1-765d-49b4-bc8c-f224b08aab91 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.160290 Nov 16 00:32:08.131603 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 245/485] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:07 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:08.212505 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-30b9d305-30a9-42fa-9e3b-a33cb733254d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:08.213036 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-30b9d305-30a9-42fa-9e3b-a33cb733254d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:08.220437 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-30b9d305-30a9-42fa-9e3b-a33cb733254d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:08.220889 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-30b9d305-30a9-42fa-9e3b-a33cb733254d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:08.221678 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-30b9d305-30a9-42fa-9e3b-a33cb733254d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:08.222119 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-30b9d305-30a9-42fa-9e3b-a33cb733254d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:08.354451 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-30b9d305-30a9-42fa-9e3b-a33cb733254d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:08.362112 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-30b9d305-30a9-42fa-9e3b-a33cb733254d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1507 microversion: 2.1 time: 0.153364 Nov 16 00:32:08.362679 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 241/486] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:08 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:08.869857 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-623cd29e-90aa-4787-a3c9-8a236dcb7300 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:08.871000 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-623cd29e-90aa-4787-a3c9-8a236dcb7300 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:08.882054 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-623cd29e-90aa-4787-a3c9-8a236dcb7300 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:08.882809 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-623cd29e-90aa-4787-a3c9-8a236dcb7300 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:08.884289 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-623cd29e-90aa-4787-a3c9-8a236dcb7300 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:08.885035 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-623cd29e-90aa-4787-a3c9-8a236dcb7300 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:09.019520 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-623cd29e-90aa-4787-a3c9-8a236dcb7300 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:09.028318 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-623cd29e-90aa-4787-a3c9-8a236dcb7300 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:09.029776 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-623cd29e-90aa-4787-a3c9-8a236dcb7300 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:09.030922 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-623cd29e-90aa-4787-a3c9-8a236dcb7300 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.167898 Nov 16 00:32:09.031544 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 246/487] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:08 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:32:09.126718 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d8e180d1-ca58-4b1a-9afe-d50df45de96c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:09.128143 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d8e180d1-ca58-4b1a-9afe-d50df45de96c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:09.134062 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d8e180d1-ca58-4b1a-9afe-d50df45de96c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:09.134497 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d8e180d1-ca58-4b1a-9afe-d50df45de96c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:09.135294 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d8e180d1-ca58-4b1a-9afe-d50df45de96c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:09.135717 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d8e180d1-ca58-4b1a-9afe-d50df45de96c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:09.148251 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1e13715b-81e7-4a6e-9185-741fff3f41fb tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:09.148842 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1e13715b-81e7-4a6e-9185-741fff3f41fb tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:09.154646 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1e13715b-81e7-4a6e-9185-741fff3f41fb tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:09.155125 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1e13715b-81e7-4a6e-9185-741fff3f41fb tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:09.156460 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1e13715b-81e7-4a6e-9185-741fff3f41fb tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:09.157292 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1e13715b-81e7-4a6e-9185-741fff3f41fb tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:09.319642 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d8e180d1-ca58-4b1a-9afe-d50df45de96c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:09.322790 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-1e13715b-81e7-4a6e-9185-741fff3f41fb tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:09.329189 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d8e180d1-ca58-4b1a-9afe-d50df45de96c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.205964 Nov 16 00:32:09.329777 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 242/488] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:09 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:09.330979 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-1e13715b-81e7-4a6e-9185-741fff3f41fb tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.186396 Nov 16 00:32:09.331591 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 247/489] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:09 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:09.380342 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-95885e08-f423-4be6-b77c-71f18d67bda4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:09.380974 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-95885e08-f423-4be6-b77c-71f18d67bda4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:09.388848 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-95885e08-f423-4be6-b77c-71f18d67bda4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:09.389289 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-95885e08-f423-4be6-b77c-71f18d67bda4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:09.390898 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-95885e08-f423-4be6-b77c-71f18d67bda4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:09.391848 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-95885e08-f423-4be6-b77c-71f18d67bda4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:09.533763 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-95885e08-f423-4be6-b77c-71f18d67bda4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:09.543445 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-95885e08-f423-4be6-b77c-71f18d67bda4 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1507 microversion: 2.1 time: 0.167568 Nov 16 00:32:09.544658 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 243/490] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:09 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:10.007089 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c39d191b-f712-4f0c-bcab-067ae2634792 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:10.007950 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c39d191b-f712-4f0c-bcab-067ae2634792 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:10.014251 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c39d191b-f712-4f0c-bcab-067ae2634792 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:10.014830 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c39d191b-f712-4f0c-bcab-067ae2634792 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:10.016054 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c39d191b-f712-4f0c-bcab-067ae2634792 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:10.016708 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c39d191b-f712-4f0c-bcab-067ae2634792 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:10.060816 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-63675906-28d3-41e4-8688-ec1cc9e555b4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:10.060816 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-63675906-28d3-41e4-8688-ec1cc9e555b4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:10.060816 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-63675906-28d3-41e4-8688-ec1cc9e555b4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:10.061316 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-63675906-28d3-41e4-8688-ec1cc9e555b4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:10.061864 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-63675906-28d3-41e4-8688-ec1cc9e555b4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:10.063878 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-63675906-28d3-41e4-8688-ec1cc9e555b4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:10.128873 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.objects.instance [None req-c39d191b-f712-4f0c-bcab-067ae2634792 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lazy-loading 'services' on Instance uuid d6f376e4-af26-4799-9127-58d9efd50cdc {{(pid=122543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:32:10.212335 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-63675906-28d3-41e4-8688-ec1cc9e555b4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:10.212868 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c39d191b-f712-4f0c-bcab-067ae2634792 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/os-volume_attachments/787a13fd-05d7-4c8c-bbe6-c7e8d0a3710f" status: 202 len: 0 microversion: 2.1 time: 0.209722 Nov 16 00:32:10.213165 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 248/491] 10.222.0.31 () {58 vars in 1415 bytes} [Tue Nov 16 00:32:10 2021] DELETE /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/os-volume_attachments/787a13fd-05d7-4c8c-bbe6-c7e8d0a3710f => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:32:10.221297 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-63675906-28d3-41e4-8688-ec1cc9e555b4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:10.223295 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-63675906-28d3-41e4-8688-ec1cc9e555b4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:10.224459 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-63675906-28d3-41e4-8688-ec1cc9e555b4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.174197 Nov 16 00:32:10.225014 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 244/492] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:10 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:32:10.349683 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1548a992-6713-4ec5-ae2c-e74c4a525533 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:10.351006 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1548a992-6713-4ec5-ae2c-e74c4a525533 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:10.358660 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-bfb9df4f-3f30-4aa4-bea5-ae6ba0914fc6 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:10.359033 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1548a992-6713-4ec5-ae2c-e74c4a525533 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:10.360520 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-bfb9df4f-3f30-4aa4-bea5-ae6ba0914fc6 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:10.367276 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bfb9df4f-3f30-4aa4-bea5-ae6ba0914fc6 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:10.368046 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bfb9df4f-3f30-4aa4-bea5-ae6ba0914fc6 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:10.369098 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bfb9df4f-3f30-4aa4-bea5-ae6ba0914fc6 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:10.370349 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bfb9df4f-3f30-4aa4-bea5-ae6ba0914fc6 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:10.370466 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1548a992-6713-4ec5-ae2c-e74c4a525533 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:10.371430 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1548a992-6713-4ec5-ae2c-e74c4a525533 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:10.372038 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1548a992-6713-4ec5-ae2c-e74c4a525533 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:10.520506 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-1548a992-6713-4ec5-ae2c-e74c4a525533 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:10.535438 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-bfb9df4f-3f30-4aa4-bea5-ae6ba0914fc6 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:10.544461 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-bfb9df4f-3f30-4aa4-bea5-ae6ba0914fc6 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.192149 Nov 16 00:32:10.545355 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 245/493] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:10 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:10.550173 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-1548a992-6713-4ec5-ae2c-e74c4a525533 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.204715 Nov 16 00:32:10.560733 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 249/494] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:10 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:10.568277 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a41e7bf8-14a3-4178-b8b4-87e2422379ef tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:10.569432 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a41e7bf8-14a3-4178-b8b4-87e2422379ef tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:10.579227 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a41e7bf8-14a3-4178-b8b4-87e2422379ef tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:10.579676 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a41e7bf8-14a3-4178-b8b4-87e2422379ef tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:10.580468 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a41e7bf8-14a3-4178-b8b4-87e2422379ef tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:10.580896 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a41e7bf8-14a3-4178-b8b4-87e2422379ef tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:10.747261 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a41e7bf8-14a3-4178-b8b4-87e2422379ef tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:10.756684 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a41e7bf8-14a3-4178-b8b4-87e2422379ef tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1507 microversion: 2.1 time: 0.195366 Nov 16 00:32:10.771851 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 246/495] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:10 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1507 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:11.247028 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-b07947bf-323b-498b-a25c-176e1d70272b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:11.249137 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b07947bf-323b-498b-a25c-176e1d70272b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:11.256943 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b07947bf-323b-498b-a25c-176e1d70272b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:11.257382 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b07947bf-323b-498b-a25c-176e1d70272b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:11.258166 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b07947bf-323b-498b-a25c-176e1d70272b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:11.258886 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b07947bf-323b-498b-a25c-176e1d70272b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:11.396814 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-b07947bf-323b-498b-a25c-176e1d70272b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:11.405689 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-b07947bf-323b-498b-a25c-176e1d70272b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:11.408129 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-b07947bf-323b-498b-a25c-176e1d70272b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:11.409290 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-b07947bf-323b-498b-a25c-176e1d70272b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.169070 Nov 16 00:32:11.409845 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 250/496] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:11 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:32:11.575420 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-5610974e-5194-4abc-9301-ac351c4f0274 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:11.576597 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-5610974e-5194-4abc-9301-ac351c4f0274 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:11.580618 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a51128aa-f58a-49ca-8b11-ecf86f3c13c9 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:11.585527 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a51128aa-f58a-49ca-8b11-ecf86f3c13c9 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:11.587371 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5610974e-5194-4abc-9301-ac351c4f0274 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:11.587822 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5610974e-5194-4abc-9301-ac351c4f0274 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:11.588686 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5610974e-5194-4abc-9301-ac351c4f0274 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:11.589119 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5610974e-5194-4abc-9301-ac351c4f0274 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:11.594091 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a51128aa-f58a-49ca-8b11-ecf86f3c13c9 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:11.594515 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a51128aa-f58a-49ca-8b11-ecf86f3c13c9 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:11.595329 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a51128aa-f58a-49ca-8b11-ecf86f3c13c9 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:11.601067 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a51128aa-f58a-49ca-8b11-ecf86f3c13c9 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:11.737637 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-5610974e-5194-4abc-9301-ac351c4f0274 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:11.743022 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a51128aa-f58a-49ca-8b11-ecf86f3c13c9 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:11.746477 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-5610974e-5194-4abc-9301-ac351c4f0274 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.174519 Nov 16 00:32:11.747464 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 251/497] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:11 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:11.752314 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a51128aa-f58a-49ca-8b11-ecf86f3c13c9 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.186968 Nov 16 00:32:11.753104 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 247/498] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:11 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:11.778958 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-319f79e4-39b8-4509-b88d-b1b121f3e6cd tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:11.780010 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-319f79e4-39b8-4509-b88d-b1b121f3e6cd tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:11.788785 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-319f79e4-39b8-4509-b88d-b1b121f3e6cd tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:11.789390 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-319f79e4-39b8-4509-b88d-b1b121f3e6cd tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:11.790527 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-319f79e4-39b8-4509-b88d-b1b121f3e6cd tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:11.791173 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-319f79e4-39b8-4509-b88d-b1b121f3e6cd tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:11.944914 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-319f79e4-39b8-4509-b88d-b1b121f3e6cd tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:11.953299 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-319f79e4-39b8-4509-b88d-b1b121f3e6cd tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1507 microversion: 2.1 time: 0.177703 Nov 16 00:32:11.954070 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 252/499] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:11 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:12.428270 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-5a2b255c-2d9f-4653-b2fe-7569b0376363 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:12.428870 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-5a2b255c-2d9f-4653-b2fe-7569b0376363 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:12.435241 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5a2b255c-2d9f-4653-b2fe-7569b0376363 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:12.435697 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5a2b255c-2d9f-4653-b2fe-7569b0376363 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:12.436537 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5a2b255c-2d9f-4653-b2fe-7569b0376363 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:12.437198 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5a2b255c-2d9f-4653-b2fe-7569b0376363 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:12.580736 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-5a2b255c-2d9f-4653-b2fe-7569b0376363 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:12.589468 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-5a2b255c-2d9f-4653-b2fe-7569b0376363 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:12.590988 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-5a2b255c-2d9f-4653-b2fe-7569b0376363 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:12.592210 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-5a2b255c-2d9f-4653-b2fe-7569b0376363 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.168015 Nov 16 00:32:12.592753 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 248/500] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:12 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:32:12.764960 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-2a242a30-b8f7-48ee-bf42-10b92e3c71d1 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:12.766738 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-2a242a30-b8f7-48ee-bf42-10b92e3c71d1 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:12.774325 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2a242a30-b8f7-48ee-bf42-10b92e3c71d1 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:12.774767 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2a242a30-b8f7-48ee-bf42-10b92e3c71d1 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:12.778424 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-9bbc934a-f31e-462a-87dd-1d4608bc1b05 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:12.779913 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2a242a30-b8f7-48ee-bf42-10b92e3c71d1 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:12.780342 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2a242a30-b8f7-48ee-bf42-10b92e3c71d1 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:12.783337 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-9bbc934a-f31e-462a-87dd-1d4608bc1b05 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:12.791680 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9bbc934a-f31e-462a-87dd-1d4608bc1b05 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:12.792123 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9bbc934a-f31e-462a-87dd-1d4608bc1b05 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:12.792906 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9bbc934a-f31e-462a-87dd-1d4608bc1b05 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:12.793337 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9bbc934a-f31e-462a-87dd-1d4608bc1b05 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:12.926262 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2a242a30-b8f7-48ee-bf42-10b92e3c71d1 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:12.933630 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-2a242a30-b8f7-48ee-bf42-10b92e3c71d1 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.172707 Nov 16 00:32:12.934203 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 253/501] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:12 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:12.950517 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-9bbc934a-f31e-462a-87dd-1d4608bc1b05 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:12.960081 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-9bbc934a-f31e-462a-87dd-1d4608bc1b05 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.189020 Nov 16 00:32:12.961449 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 249/502] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:12 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:12.976242 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c2f7f838-d236-4d9a-91bb-42dacdf00fe7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:12.976884 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c2f7f838-d236-4d9a-91bb-42dacdf00fe7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:12.983496 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c2f7f838-d236-4d9a-91bb-42dacdf00fe7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:12.984469 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c2f7f838-d236-4d9a-91bb-42dacdf00fe7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:12.985265 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c2f7f838-d236-4d9a-91bb-42dacdf00fe7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:12.985696 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c2f7f838-d236-4d9a-91bb-42dacdf00fe7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:13.121756 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c2f7f838-d236-4d9a-91bb-42dacdf00fe7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:13.129949 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c2f7f838-d236-4d9a-91bb-42dacdf00fe7 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1507 microversion: 2.1 time: 0.157313 Nov 16 00:32:13.130527 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 254/503] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:12 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:13.612166 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3908be56-298d-44dc-83d5-3e1a4dda2834 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:13.612798 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3908be56-298d-44dc-83d5-3e1a4dda2834 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:13.618718 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3908be56-298d-44dc-83d5-3e1a4dda2834 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:13.619201 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3908be56-298d-44dc-83d5-3e1a4dda2834 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:13.619977 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3908be56-298d-44dc-83d5-3e1a4dda2834 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:13.620408 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3908be56-298d-44dc-83d5-3e1a4dda2834 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:13.756547 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3908be56-298d-44dc-83d5-3e1a4dda2834 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:13.770335 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3908be56-298d-44dc-83d5-3e1a4dda2834 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:13.773084 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3908be56-298d-44dc-83d5-3e1a4dda2834 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:13.775104 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-3908be56-298d-44dc-83d5-3e1a4dda2834 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.167126 Nov 16 00:32:13.776054 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 250/504] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:13 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:32:13.951173 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-3b1e2a20-3c1f-485d-8b2a-1201747dd9ac tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:13.951751 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-3b1e2a20-3c1f-485d-8b2a-1201747dd9ac tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:13.958313 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3b1e2a20-3c1f-485d-8b2a-1201747dd9ac tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:13.958744 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3b1e2a20-3c1f-485d-8b2a-1201747dd9ac tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:13.959593 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3b1e2a20-3c1f-485d-8b2a-1201747dd9ac tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:13.960015 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3b1e2a20-3c1f-485d-8b2a-1201747dd9ac tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:13.979502 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-db2c8a57-b210-48f7-8ed4-151a375e9819 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:13.980109 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-db2c8a57-b210-48f7-8ed4-151a375e9819 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:13.986678 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-db2c8a57-b210-48f7-8ed4-151a375e9819 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:13.987068 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-db2c8a57-b210-48f7-8ed4-151a375e9819 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:13.987929 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-db2c8a57-b210-48f7-8ed4-151a375e9819 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:13.988373 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-db2c8a57-b210-48f7-8ed4-151a375e9819 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:14.097296 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-3b1e2a20-3c1f-485d-8b2a-1201747dd9ac tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:14.105117 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-3b1e2a20-3c1f-485d-8b2a-1201747dd9ac tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.157570 Nov 16 00:32:14.105693 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 255/505] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:13 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:14.134907 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-db2c8a57-b210-48f7-8ed4-151a375e9819 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:14.143596 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-db2c8a57-b210-48f7-8ed4-151a375e9819 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.167419 Nov 16 00:32:14.144163 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 251/506] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:13 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:14.147884 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-b753ed77-26c5-4d00-a7ad-7a9a4335f0a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:14.148485 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b753ed77-26c5-4d00-a7ad-7a9a4335f0a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:14.154694 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b753ed77-26c5-4d00-a7ad-7a9a4335f0a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:14.155161 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b753ed77-26c5-4d00-a7ad-7a9a4335f0a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:14.155940 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b753ed77-26c5-4d00-a7ad-7a9a4335f0a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:14.156358 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b753ed77-26c5-4d00-a7ad-7a9a4335f0a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:14.304293 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-b753ed77-26c5-4d00-a7ad-7a9a4335f0a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:14.312553 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-b753ed77-26c5-4d00-a7ad-7a9a4335f0a3 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1507 microversion: 2.1 time: 0.167786 Nov 16 00:32:14.313203 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 256/507] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:14 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:14.801294 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-7a6faaf2-a3ff-4fd4-ac24-923cc42bf4ca tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:14.802045 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-7a6faaf2-a3ff-4fd4-ac24-923cc42bf4ca tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:14.808042 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7a6faaf2-a3ff-4fd4-ac24-923cc42bf4ca tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:14.808475 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7a6faaf2-a3ff-4fd4-ac24-923cc42bf4ca tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:14.809241 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7a6faaf2-a3ff-4fd4-ac24-923cc42bf4ca tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:14.809663 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7a6faaf2-a3ff-4fd4-ac24-923cc42bf4ca tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:14.943904 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-7a6faaf2-a3ff-4fd4-ac24-923cc42bf4ca tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:14.956336 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-7a6faaf2-a3ff-4fd4-ac24-923cc42bf4ca tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:14.958930 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-7a6faaf2-a3ff-4fd4-ac24-923cc42bf4ca tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:14.960686 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-7a6faaf2-a3ff-4fd4-ac24-923cc42bf4ca tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.163390 Nov 16 00:32:14.961433 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 252/508] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:14 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:32:15.121943 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-e2de2192-b9ae-4da4-9873-15690bfcbfdc tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:15.123040 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-e2de2192-b9ae-4da4-9873-15690bfcbfdc tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:15.130518 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e2de2192-b9ae-4da4-9873-15690bfcbfdc tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:15.130966 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e2de2192-b9ae-4da4-9873-15690bfcbfdc tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:15.131837 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e2de2192-b9ae-4da4-9873-15690bfcbfdc tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:15.132265 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e2de2192-b9ae-4da4-9873-15690bfcbfdc tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:15.147022 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 00:32:15.147312 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: Tue Nov 16 00:32:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 (ip 10.222.0.31) !!! Nov 16 00:32:15.170044 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-ecdba3d2-9756-4808-bb27-d12004b633dc tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:15.170649 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-ecdba3d2-9756-4808-bb27-d12004b633dc tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:15.177686 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ecdba3d2-9756-4808-bb27-d12004b633dc tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:15.178132 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ecdba3d2-9756-4808-bb27-d12004b633dc tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:15.178908 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ecdba3d2-9756-4808-bb27-d12004b633dc tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:15.179377 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ecdba3d2-9756-4808-bb27-d12004b633dc tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:15.295734 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e2de2192-b9ae-4da4-9873-15690bfcbfdc tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:15.304686 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-e2de2192-b9ae-4da4-9873-15690bfcbfdc tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1315 microversion: 2.1 time: 0.186665 Nov 16 00:32:15.305270 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 257/509] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:15 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:15.330680 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c241f67a-5042-4187-b7ee-b47dd1c3653c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:15.331694 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c241f67a-5042-4187-b7ee-b47dd1c3653c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:15.338145 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c241f67a-5042-4187-b7ee-b47dd1c3653c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:15.338685 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c241f67a-5042-4187-b7ee-b47dd1c3653c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:15.338877 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-ecdba3d2-9756-4808-bb27-d12004b633dc tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:15.339672 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c241f67a-5042-4187-b7ee-b47dd1c3653c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:15.340216 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c241f67a-5042-4187-b7ee-b47dd1c3653c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:15.348258 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-ecdba3d2-9756-4808-bb27-d12004b633dc tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1358 microversion: 2.1 time: 0.182201 Nov 16 00:32:15.349059 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 253/510] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:15 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:15.472701 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c241f67a-5042-4187-b7ee-b47dd1c3653c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:15.480840 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c241f67a-5042-4187-b7ee-b47dd1c3653c tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1507 microversion: 2.1 time: 0.155074 Nov 16 00:32:15.481412 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 258/511] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:15 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:15.980373 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-499422b1-ebeb-4695-bbde-369f74d69c72 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:15.980957 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-499422b1-ebeb-4695-bbde-369f74d69c72 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:15.988131 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-499422b1-ebeb-4695-bbde-369f74d69c72 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:15.988577 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-499422b1-ebeb-4695-bbde-369f74d69c72 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:15.989355 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-499422b1-ebeb-4695-bbde-369f74d69c72 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:15.989789 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-499422b1-ebeb-4695-bbde-369f74d69c72 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:16.126728 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-499422b1-ebeb-4695-bbde-369f74d69c72 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:16.143437 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-499422b1-ebeb-4695-bbde-369f74d69c72 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:16.146681 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-499422b1-ebeb-4695-bbde-369f74d69c72 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:16.149100 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-499422b1-ebeb-4695-bbde-369f74d69c72 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.172134 Nov 16 00:32:16.150173 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 254/512] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:15 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:32:16.324235 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ada66081-4daf-4191-a235-3f1df1181e05 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:16.324878 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ada66081-4daf-4191-a235-3f1df1181e05 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:16.330895 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ada66081-4daf-4191-a235-3f1df1181e05 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:16.331290 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ada66081-4daf-4191-a235-3f1df1181e05 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:16.332114 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ada66081-4daf-4191-a235-3f1df1181e05 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:16.332824 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ada66081-4daf-4191-a235-3f1df1181e05 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:16.366486 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-4aa72597-2f5e-4af3-b558-266e33f7cbc7 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:16.367101 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-4aa72597-2f5e-4af3-b558-266e33f7cbc7 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:16.373436 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4aa72597-2f5e-4af3-b558-266e33f7cbc7 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:16.373872 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4aa72597-2f5e-4af3-b558-266e33f7cbc7 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:16.374631 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4aa72597-2f5e-4af3-b558-266e33f7cbc7 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:16.375067 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4aa72597-2f5e-4af3-b558-266e33f7cbc7 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:16.467199 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-ada66081-4daf-4191-a235-3f1df1181e05 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:16.476321 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ada66081-4daf-4191-a235-3f1df1181e05 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1465 microversion: 2.1 time: 0.157468 Nov 16 00:32:16.476899 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 259/513] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:16 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1465 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:16.498198 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-3633351c-4453-401a-b1d4-9bbc3fcbbd56 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:16.498815 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-3633351c-4453-401a-b1d4-9bbc3fcbbd56 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:16.505631 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3633351c-4453-401a-b1d4-9bbc3fcbbd56 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:16.506196 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3633351c-4453-401a-b1d4-9bbc3fcbbd56 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:16.507077 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3633351c-4453-401a-b1d4-9bbc3fcbbd56 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:16.507627 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3633351c-4453-401a-b1d4-9bbc3fcbbd56 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:16.521731 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-4aa72597-2f5e-4af3-b558-266e33f7cbc7 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:16.529307 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-4aa72597-2f5e-4af3-b558-266e33f7cbc7 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1549 microversion: 2.1 time: 0.166737 Nov 16 00:32:16.529904 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 255/514] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:16 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:16.535305 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-06c1a21b-6d94-493c-b689-58aefe7b027c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:16.535792 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-06c1a21b-6d94-493c-b689-58aefe7b027c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:16.542409 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-06c1a21b-6d94-493c-b689-58aefe7b027c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:16.542862 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-06c1a21b-6d94-493c-b689-58aefe7b027c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:16.543645 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-06c1a21b-6d94-493c-b689-58aefe7b027c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:16.544075 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-06c1a21b-6d94-493c-b689-58aefe7b027c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:16.579902 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-06c1a21b-6d94-493c-b689-58aefe7b027c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Going to try to terminate instance {{(pid=122544) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:32:16.643878 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-3633351c-4453-401a-b1d4-9bbc3fcbbd56 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:16.652142 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-3633351c-4453-401a-b1d4-9bbc3fcbbd56 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1507 microversion: 2.1 time: 0.157603 Nov 16 00:32:16.652820 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 260/515] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:16 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:16.659114 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-36c26f04-e179-495c-9dac-3d09ed9dd011 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:16.659955 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-36c26f04-e179-495c-9dac-3d09ed9dd011 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:16.666444 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-36c26f04-e179-495c-9dac-3d09ed9dd011 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:16.667286 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-36c26f04-e179-495c-9dac-3d09ed9dd011 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:16.667725 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-36c26f04-e179-495c-9dac-3d09ed9dd011 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:16.668158 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-36c26f04-e179-495c-9dac-3d09ed9dd011 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:16.682448 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-06c1a21b-6d94-493c-b689-58aefe7b027c tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "DELETE /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 204 len: 0 microversion: 2.1 time: 0.151086 Nov 16 00:32:16.683244 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 256/516] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:32:16 2021] DELETE /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 00:32:16.689829 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-4caf9eb9-d5c4-4850-b673-826cf32d3682 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:32:16.696481 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4caf9eb9-d5c4-4850-b673-826cf32d3682 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:16.696979 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4caf9eb9-d5c4-4850-b673-826cf32d3682 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:16.724706 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-4caf9eb9-d5c4-4850-b673-826cf32d3682 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Going to try to stop instance {{(pid=122544) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Nov 16 00:32:16.775810 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-4caf9eb9-d5c4-4850-b673-826cf32d3682 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 202 len: 0 microversion: 2.1 time: 0.090764 Nov 16 00:32:16.776597 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 257/517] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:32:16 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:32:16.783028 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-65c05eb8-bb4c-4451-bb4f-bc9f7051361a tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:16.783766 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-65c05eb8-bb4c-4451-bb4f-bc9f7051361a tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:16.790843 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-65c05eb8-bb4c-4451-bb4f-bc9f7051361a tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:16.791410 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-65c05eb8-bb4c-4451-bb4f-bc9f7051361a tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:16.792220 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-65c05eb8-bb4c-4451-bb4f-bc9f7051361a tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:16.792712 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-65c05eb8-bb4c-4451-bb4f-bc9f7051361a tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:16.813005 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-36c26f04-e179-495c-9dac-3d09ed9dd011 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:16.820674 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-36c26f04-e179-495c-9dac-3d09ed9dd011 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1549 microversion: 2.1 time: 0.166916 Nov 16 00:32:16.821248 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 261/518] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:16 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:16.825531 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-4330915f-d373-4522-85d5-9b19d4018767 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:16.826122 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-4330915f-d373-4522-85d5-9b19d4018767 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:16.832140 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4330915f-d373-4522-85d5-9b19d4018767 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:16.832536 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4330915f-d373-4522-85d5-9b19d4018767 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:16.833315 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4330915f-d373-4522-85d5-9b19d4018767 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:16.833744 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4330915f-d373-4522-85d5-9b19d4018767 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:16.942031 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-65c05eb8-bb4c-4451-bb4f-bc9f7051361a tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:16.949414 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-65c05eb8-bb4c-4451-bb4f-bc9f7051361a tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1471 microversion: 2.1 time: 0.171817 Nov 16 00:32:16.950170 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 258/519] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:16 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:16.955032 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-b1dff1b3-c3e6-4ef2-8888-1cef1f6e85a6 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:16.958579 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:32:16.958579 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:32:16.959686 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-b1dff1b3-c3e6-4ef2-8888-1cef1f6e85a6 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:16.960501 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-b1dff1b3-c3e6-4ef2-8888-1cef1f6e85a6 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Searching by: {'deleted': False, 'project_id': '7d4495714639486cad8d6a4039009581'} {{(pid=122544) get_all /opt/stack/nova/nova/compute/api.py:2905}} Nov 16 00:32:16.969872 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-4330915f-d373-4522-85d5-9b19d4018767 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:16.971394 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b1dff1b3-c3e6-4ef2-8888-1cef1f6e85a6 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:16.971978 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b1dff1b3-c3e6-4ef2-8888-1cef1f6e85a6 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:16.972614 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b1dff1b3-c3e6-4ef2-8888-1cef1f6e85a6 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:16.973051 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b1dff1b3-c3e6-4ef2-8888-1cef1f6e85a6 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:16.977920 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-4330915f-d373-4522-85d5-9b19d4018767 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1677 microversion: 2.1 time: 0.155472 Nov 16 00:32:16.978650 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 262/520] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:16 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:17.074472 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.multi_cell_list [None req-b1dff1b3-c3e6-4ef2-8888-1cef1f6e85a6 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122544) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 16 00:32:17.174019 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-2baf7612-341d-4b7b-9291-4d3c88235087 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:17.175332 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-2baf7612-341d-4b7b-9291-4d3c88235087 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:17.185892 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2baf7612-341d-4b7b-9291-4d3c88235087 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:17.186663 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2baf7612-341d-4b7b-9291-4d3c88235087 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:17.188261 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2baf7612-341d-4b7b-9291-4d3c88235087 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:17.189064 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2baf7612-341d-4b7b-9291-4d3c88235087 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:17.194007 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-b1dff1b3-c3e6-4ef2-8888-1cef1f6e85a6 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.242933 Nov 16 00:32:17.194827 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 259/521] 10.222.0.31 () {58 vars in 1124 bytes} [Tue Nov 16 00:32:16 2021] GET /compute/v2.1/servers => generated 342 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:32:17.208079 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-b42a8ab9-1d01-4e99-85a3-d1ffb83d82d2 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:17.209224 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-b42a8ab9-1d01-4e99-85a3-d1ffb83d82d2 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:17.220348 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b42a8ab9-1d01-4e99-85a3-d1ffb83d82d2 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:17.221133 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b42a8ab9-1d01-4e99-85a3-d1ffb83d82d2 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:17.222570 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b42a8ab9-1d01-4e99-85a3-d1ffb83d82d2 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:17.223422 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b42a8ab9-1d01-4e99-85a3-d1ffb83d82d2 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:17.347022 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2baf7612-341d-4b7b-9291-4d3c88235087 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:17.363326 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2baf7612-341d-4b7b-9291-4d3c88235087 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:17.365694 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2baf7612-341d-4b7b-9291-4d3c88235087 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:17.367713 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-2baf7612-341d-4b7b-9291-4d3c88235087 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.201679 Nov 16 00:32:17.368622 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 263/522] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:17 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:32:17.444166 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-b42a8ab9-1d01-4e99-85a3-d1ffb83d82d2 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:17.454701 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-b42a8ab9-1d01-4e99-85a3-d1ffb83d82d2 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1549 microversion: 2.1 time: 0.252884 Nov 16 00:32:17.455487 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 260/523] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:17 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1549 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:17.676213 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-6186214d-5c4e-4342-bd2f-fd4e0c059d42 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:17.677444 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-6186214d-5c4e-4342-bd2f-fd4e0c059d42 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:17.688811 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6186214d-5c4e-4342-bd2f-fd4e0c059d42 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:17.689737 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6186214d-5c4e-4342-bd2f-fd4e0c059d42 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:17.691357 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6186214d-5c4e-4342-bd2f-fd4e0c059d42 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:17.692338 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6186214d-5c4e-4342-bd2f-fd4e0c059d42 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:17.974668 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-85e616bf-caee-4729-9b04-dce0e3b4150b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:17.975729 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-85e616bf-caee-4729-9b04-dce0e3b4150b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:17.984947 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-85e616bf-caee-4729-9b04-dce0e3b4150b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:17.985679 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-85e616bf-caee-4729-9b04-dce0e3b4150b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:17.987148 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-85e616bf-caee-4729-9b04-dce0e3b4150b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:17.987853 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-85e616bf-caee-4729-9b04-dce0e3b4150b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:18.009699 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-6186214d-5c4e-4342-bd2f-fd4e0c059d42 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:18.032416 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-6186214d-5c4e-4342-bd2f-fd4e0c059d42 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 200 len: 1507 microversion: 2.1 time: 0.364702 Nov 16 00:32:18.034427 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 264/524] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:17 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 1507 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:18.079731 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-02aa7bea-84c6-4e0b-b236-61388538b7d2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:18.080984 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-02aa7bea-84c6-4e0b-b236-61388538b7d2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:18.090006 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-02aa7bea-84c6-4e0b-b236-61388538b7d2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:18.090815 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-02aa7bea-84c6-4e0b-b236-61388538b7d2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:18.091858 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-02aa7bea-84c6-4e0b-b236-61388538b7d2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:18.092481 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-02aa7bea-84c6-4e0b-b236-61388538b7d2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:18.249414 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-85e616bf-caee-4729-9b04-dce0e3b4150b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:18.263779 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-85e616bf-caee-4729-9b04-dce0e3b4150b tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1471 microversion: 2.1 time: 0.296002 Nov 16 00:32:18.265819 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 261/525] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:17 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1471 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:18.285866 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-d5ad8ccf-b415-41d7-91ee-290e8d091271 req-c97feb48-2e29-4cb3-89b8-ac1fb2f86610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fc982a-6c0b-4489-8e17-7be77c13ddaf", "name": "network-vif-deleted", "tag": "cce90d18-c28e-4785-a1d3-e0ca956a9084"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:32:18.290888 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:32:18.290888 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:32:18.304941 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-d5ad8ccf-b415-41d7-91ee-290e8d091271 req-c97feb48-2e29-4cb3-89b8-ac1fb2f86610 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:18.305773 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-d5ad8ccf-b415-41d7-91ee-290e8d091271 req-c97feb48-2e29-4cb3-89b8-ac1fb2f86610 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:18.332496 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-02aa7bea-84c6-4e0b-b236-61388538b7d2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:18.332886 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-d5ad8ccf-b415-41d7-91ee-290e8d091271 req-c97feb48-2e29-4cb3-89b8-ac1fb2f86610 service nova] Creating event network-vif-deleted:cce90d18-c28e-4785-a1d3-e0ca956a9084 for instance e9fc982a-6c0b-4489-8e17-7be77c13ddaf on hv-cinder-81115 Nov 16 00:32:18.342030 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-d5ad8ccf-b415-41d7-91ee-290e8d091271 req-c97feb48-2e29-4cb3-89b8-ac1fb2f86610 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066771 Nov 16 00:32:18.343668 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 262/526] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:32:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:32:18.346046 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-02aa7bea-84c6-4e0b-b236-61388538b7d2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1677 microversion: 2.1 time: 0.280639 Nov 16 00:32:18.346399 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 265/527] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:18 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1677 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:18.388362 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-923de29e-3e9e-4a77-bc5f-12b3da30e64e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:18.389064 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-923de29e-3e9e-4a77-bc5f-12b3da30e64e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:18.396132 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-923de29e-3e9e-4a77-bc5f-12b3da30e64e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:18.396563 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-923de29e-3e9e-4a77-bc5f-12b3da30e64e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:18.397339 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-923de29e-3e9e-4a77-bc5f-12b3da30e64e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:18.397759 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-923de29e-3e9e-4a77-bc5f-12b3da30e64e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:18.545500 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-923de29e-3e9e-4a77-bc5f-12b3da30e64e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:18.555748 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-923de29e-3e9e-4a77-bc5f-12b3da30e64e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:18.557250 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-923de29e-3e9e-4a77-bc5f-12b3da30e64e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:18.558588 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-923de29e-3e9e-4a77-bc5f-12b3da30e64e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.174331 Nov 16 00:32:18.559441 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 263/528] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:18 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:32:19.070401 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8cd3936b-c18b-49fe-b00f-1207e7f65d55 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:19.071693 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8cd3936b-c18b-49fe-b00f-1207e7f65d55 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: e9fc982a-6c0b-4489-8e17-7be77c13ddaf] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:19.083329 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8cd3936b-c18b-49fe-b00f-1207e7f65d55 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:19.084123 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8cd3936b-c18b-49fe-b00f-1207e7f65d55 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:19.085554 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8cd3936b-c18b-49fe-b00f-1207e7f65d55 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:19.086588 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8cd3936b-c18b-49fe-b00f-1207e7f65d55 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:19.117569 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-8cd3936b-c18b-49fe-b00f-1207e7f65d55 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] HTTP exception thrown: Instance e9fc982a-6c0b-4489-8e17-7be77c13ddaf could not be found. Nov 16 00:32:19.119003 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8cd3936b-c18b-49fe-b00f-1207e7f65d55 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Returning 404 to user: Instance e9fc982a-6c0b-4489-8e17-7be77c13ddaf could not be found. {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:32:19.124085 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8cd3936b-c18b-49fe-b00f-1207e7f65d55 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf" status: 404 len: 111 microversion: 2.1 time: 0.061998 Nov 16 00:32:19.133977 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-9811ba77-e569-403b-b933-4ac6717c025f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:19.134476 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-9811ba77-e569-403b-b933-4ac6717c025f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:19.135456 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 266/529] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:19 2021] GET /compute/v2.1/servers/e9fc982a-6c0b-4489-8e17-7be77c13ddaf => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:32:19.145005 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9811ba77-e569-403b-b933-4ac6717c025f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:19.145864 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9811ba77-e569-403b-b933-4ac6717c025f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:19.146919 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9811ba77-e569-403b-b933-4ac6717c025f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:19.147647 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9811ba77-e569-403b-b933-4ac6717c025f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:19.189348 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-9811ba77-e569-403b-b933-4ac6717c025f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Going to try to terminate instance {{(pid=122544) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:32:19.292251 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-fd1b259a-77fe-4ed4-a116-2bc28e0afeff tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b3e67b7-837f-425a-beda-fe121a016cdc"}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:32:19.294768 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-fd1b259a-77fe-4ed4-a116-2bc28e0afeff tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:19.306283 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fd1b259a-77fe-4ed4-a116-2bc28e0afeff tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:19.307130 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fd1b259a-77fe-4ed4-a116-2bc28e0afeff tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:19.309457 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fd1b259a-77fe-4ed4-a116-2bc28e0afeff tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:19.310519 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fd1b259a-77fe-4ed4-a116-2bc28e0afeff tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:19.323598 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-9811ba77-e569-403b-b933-4ac6717c025f tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "DELETE /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 204 len: 0 microversion: 2.1 time: 0.192558 Nov 16 00:32:19.324783 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 264/530] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:32:19 2021] DELETE /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 16 00:32:19.333327 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e64f52f4-b806-4f09-aa77-ac7468f85a5a tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:19.334581 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e64f52f4-b806-4f09-aa77-ac7468f85a5a tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:19.342446 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e64f52f4-b806-4f09-aa77-ac7468f85a5a tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:19.343353 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e64f52f4-b806-4f09-aa77-ac7468f85a5a tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:19.344273 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e64f52f4-b806-4f09-aa77-ac7468f85a5a tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:19.344701 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e64f52f4-b806-4f09-aa77-ac7468f85a5a tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:19.381838 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e64f52f4-b806-4f09-aa77-ac7468f85a5a tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:19.382416 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e64f52f4-b806-4f09-aa77-ac7468f85a5a tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:19.383032 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.objects.instance [None req-e64f52f4-b806-4f09-aa77-ac7468f85a5a tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lazy-loading 'fault' on Instance uuid 44cd98fe-3bda-4129-a9d1-ad922d5c3d10 {{(pid=122544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:32:19.436608 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e64f52f4-b806-4f09-aa77-ac7468f85a5a tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bacb60350ce449d97bf145ddb25af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4262ca01104142daa42d05ef22e0d643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:19.453398 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e64f52f4-b806-4f09-aa77-ac7468f85a5a tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 200 len: 1305 microversion: 2.1 time: 0.124086 Nov 16 00:32:19.455109 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 265/531] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:19 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 1305 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:19.463709 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-6f46bb67-9ecc-4ed9-8efe-57cdb66081ad tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:19.464829 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-6f46bb67-9ecc-4ed9-8efe-57cdb66081ad tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:19.474522 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6f46bb67-9ecc-4ed9-8efe-57cdb66081ad tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:19.475228 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6f46bb67-9ecc-4ed9-8efe-57cdb66081ad tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:19.476159 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6f46bb67-9ecc-4ed9-8efe-57cdb66081ad tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:19.476709 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6f46bb67-9ecc-4ed9-8efe-57cdb66081ad tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:19.656522 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-6f46bb67-9ecc-4ed9-8efe-57cdb66081ad tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:19.672363 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-6f46bb67-9ecc-4ed9-8efe-57cdb66081ad tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.214823 Nov 16 00:32:19.673634 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 266/532] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:19 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:19.686497 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-808cd5d9-629e-40c5-bb17-b31745f2aafb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:19.688224 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-808cd5d9-629e-40c5-bb17-b31745f2aafb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:19.700622 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-808cd5d9-629e-40c5-bb17-b31745f2aafb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:19.701899 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-fd1b259a-77fe-4ed4-a116-2bc28e0afeff tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "POST /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417999 Nov 16 00:32:19.702943 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-808cd5d9-629e-40c5-bb17-b31745f2aafb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:19.703887 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 267/533] 10.222.0.31 () {60 vars in 1322 bytes} [Tue Nov 16 00:32:19 2021] POST /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81/os-volume_attachments => generated 194 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:32:19.705424 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-808cd5d9-629e-40c5-bb17-b31745f2aafb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:19.706877 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-808cd5d9-629e-40c5-bb17-b31745f2aafb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:19.721984 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-9b38caad-b4bc-4fbe-b8a4-6edb6824d567 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:19.723759 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-9b38caad-b4bc-4fbe-b8a4-6edb6824d567 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:19.739903 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9b38caad-b4bc-4fbe-b8a4-6edb6824d567 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:19.741569 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9b38caad-b4bc-4fbe-b8a4-6edb6824d567 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:19.745612 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9b38caad-b4bc-4fbe-b8a4-6edb6824d567 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:19.747656 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9b38caad-b4bc-4fbe-b8a4-6edb6824d567 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:19.901196 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-808cd5d9-629e-40c5-bb17-b31745f2aafb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:19.910969 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-808cd5d9-629e-40c5-bb17-b31745f2aafb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1677 microversion: 2.1 time: 0.235480 Nov 16 00:32:19.911649 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 267/534] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:19 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1677 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:19.938649 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-9b38caad-b4bc-4fbe-b8a4-6edb6824d567 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:19.947727 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-9b38caad-b4bc-4fbe-b8a4-6edb6824d567 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:19.949328 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-9b38caad-b4bc-4fbe-b8a4-6edb6824d567 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:19.950549 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-9b38caad-b4bc-4fbe-b8a4-6edb6824d567 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.245194 Nov 16 00:32:19.951173 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 268/535] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:19 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:32:20.360542 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-3a22df3d-5209-41eb-a627-f183d35a1bc9 req-3aa7cfc6-2e71-43b7-b539-046fb2eadc7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44cd98fe-3bda-4129-a9d1-ad922d5c3d10", "name": "network-vif-deleted", "tag": "b6e9163c-8268-4e52-8726-8961a776e608"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:32:20.362160 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:32:20.362160 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:32:20.369870 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-3a22df3d-5209-41eb-a627-f183d35a1bc9 req-3aa7cfc6-2e71-43b7-b539-046fb2eadc7d service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:20.370307 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-3a22df3d-5209-41eb-a627-f183d35a1bc9 req-3aa7cfc6-2e71-43b7-b539-046fb2eadc7d service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:20.382983 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-3a22df3d-5209-41eb-a627-f183d35a1bc9 req-3aa7cfc6-2e71-43b7-b539-046fb2eadc7d service nova] Creating event network-vif-deleted:b6e9163c-8268-4e52-8726-8961a776e608 for instance 44cd98fe-3bda-4129-a9d1-ad922d5c3d10 on hv-cinder-81115 Nov 16 00:32:20.388442 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-3a22df3d-5209-41eb-a627-f183d35a1bc9 req-3aa7cfc6-2e71-43b7-b539-046fb2eadc7d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031774 Nov 16 00:32:20.389157 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 268/536] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:32:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:32:20.474954 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-17bfea1b-d9c5-4920-a5b0-0796db9f2147 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:20.475981 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-17bfea1b-d9c5-4920-a5b0-0796db9f2147 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] [instance: 44cd98fe-3bda-4129-a9d1-ad922d5c3d10] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:20.483494 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-17bfea1b-d9c5-4920-a5b0-0796db9f2147 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:20.484738 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-17bfea1b-d9c5-4920-a5b0-0796db9f2147 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:20.485799 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-17bfea1b-d9c5-4920-a5b0-0796db9f2147 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:20.486423 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-17bfea1b-d9c5-4920-a5b0-0796db9f2147 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:20.502095 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-17bfea1b-d9c5-4920-a5b0-0796db9f2147 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] HTTP exception thrown: Instance 44cd98fe-3bda-4129-a9d1-ad922d5c3d10 could not be found. Nov 16 00:32:20.502792 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-17bfea1b-d9c5-4920-a5b0-0796db9f2147 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] Returning 404 to user: Instance 44cd98fe-3bda-4129-a9d1-ad922d5c3d10 could not be found. {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:32:20.503668 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-17bfea1b-d9c5-4920-a5b0-0796db9f2147 tempest-VolumesNegativeTest-1418371630 tempest-VolumesNegativeTest-1418371630-project] 10.222.0.31 "GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10" status: 404 len: 111 microversion: 2.1 time: 0.032817 Nov 16 00:32:20.504250 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 269/537] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:20 2021] GET /compute/v2.1/servers/44cd98fe-3bda-4129-a9d1-ad922d5c3d10 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:32:20.695373 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-1ddd565b-076c-4085-a440-cf3f4c3446a8 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:20.696525 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-1ddd565b-076c-4085-a440-cf3f4c3446a8 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:20.706177 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1ddd565b-076c-4085-a440-cf3f4c3446a8 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:20.706992 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1ddd565b-076c-4085-a440-cf3f4c3446a8 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:20.707955 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1ddd565b-076c-4085-a440-cf3f4c3446a8 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:20.708808 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1ddd565b-076c-4085-a440-cf3f4c3446a8 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:20.910873 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-1ddd565b-076c-4085-a440-cf3f4c3446a8 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:20.925622 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-1ddd565b-076c-4085-a440-cf3f4c3446a8 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.235680 Nov 16 00:32:20.926910 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 269/538] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:20 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:20.932643 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-afada041-286e-4614-a2f2-1187e6b4d20c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:20.933429 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-afada041-286e-4614-a2f2-1187e6b4d20c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:20.943556 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-afada041-286e-4614-a2f2-1187e6b4d20c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:20.944290 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-afada041-286e-4614-a2f2-1187e6b4d20c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:20.945628 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-afada041-286e-4614-a2f2-1187e6b4d20c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:20.946355 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-afada041-286e-4614-a2f2-1187e6b4d20c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:20.975321 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f5985f49-cfaf-4a45-add1-07bac29c38f9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:20.975637 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f5985f49-cfaf-4a45-add1-07bac29c38f9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:20.987570 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f5985f49-cfaf-4a45-add1-07bac29c38f9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:20.988507 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f5985f49-cfaf-4a45-add1-07bac29c38f9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:20.989988 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f5985f49-cfaf-4a45-add1-07bac29c38f9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:20.991015 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f5985f49-cfaf-4a45-add1-07bac29c38f9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:21.154038 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-afada041-286e-4614-a2f2-1187e6b4d20c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:21.169152 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-afada041-286e-4614-a2f2-1187e6b4d20c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1677 microversion: 2.1 time: 0.239976 Nov 16 00:32:21.169152 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 270/539] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:20 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1677 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:21.198772 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-f5985f49-cfaf-4a45-add1-07bac29c38f9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:21.212190 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-f5985f49-cfaf-4a45-add1-07bac29c38f9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:21.213675 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-f5985f49-cfaf-4a45-add1-07bac29c38f9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:21.214889 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-f5985f49-cfaf-4a45-add1-07bac29c38f9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.248354 Nov 16 00:32:21.215486 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 270/540] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:20 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:32:21.954405 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c39bb4f7-5121-4f47-9a23-6bb69a3dfe53 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:21.955018 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c39bb4f7-5121-4f47-9a23-6bb69a3dfe53 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:21.965288 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c39bb4f7-5121-4f47-9a23-6bb69a3dfe53 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:21.965620 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c39bb4f7-5121-4f47-9a23-6bb69a3dfe53 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:21.966388 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c39bb4f7-5121-4f47-9a23-6bb69a3dfe53 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:21.966821 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c39bb4f7-5121-4f47-9a23-6bb69a3dfe53 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:22.114627 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c39bb4f7-5121-4f47-9a23-6bb69a3dfe53 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:22.125617 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c39bb4f7-5121-4f47-9a23-6bb69a3dfe53 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.174507 Nov 16 00:32:22.126502 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 271/541] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:21 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:22.192554 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-aaf59e9e-c22a-421b-8898-1763d12c6349 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:22.193201 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-aaf59e9e-c22a-421b-8898-1763d12c6349 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:22.200190 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-aaf59e9e-c22a-421b-8898-1763d12c6349 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:22.200664 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-aaf59e9e-c22a-421b-8898-1763d12c6349 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:22.201439 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-aaf59e9e-c22a-421b-8898-1763d12c6349 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:22.201865 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-aaf59e9e-c22a-421b-8898-1763d12c6349 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:22.244658 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-2861e2e0-e44f-4c4f-84d4-b8eac4ed07a4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:22.255981 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-2861e2e0-e44f-4c4f-84d4-b8eac4ed07a4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:22.263426 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2861e2e0-e44f-4c4f-84d4-b8eac4ed07a4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:22.264177 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2861e2e0-e44f-4c4f-84d4-b8eac4ed07a4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:22.265028 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2861e2e0-e44f-4c4f-84d4-b8eac4ed07a4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:22.265668 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2861e2e0-e44f-4c4f-84d4-b8eac4ed07a4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:22.388416 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-aaf59e9e-c22a-421b-8898-1763d12c6349 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:22.399933 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-aaf59e9e-c22a-421b-8898-1763d12c6349 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1677 microversion: 2.1 time: 0.211249 Nov 16 00:32:22.401098 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 271/542] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:22 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1677 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:22.440880 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2861e2e0-e44f-4c4f-84d4-b8eac4ed07a4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:22.451087 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2861e2e0-e44f-4c4f-84d4-b8eac4ed07a4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:22.453551 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2861e2e0-e44f-4c4f-84d4-b8eac4ed07a4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:22.454872 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-2861e2e0-e44f-4c4f-84d4-b8eac4ed07a4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.217256 Nov 16 00:32:22.455636 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 272/543] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:22 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:32:23.145888 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-c41cd338-b007-46ce-8e20-666689bb9b4d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:23.146489 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-c41cd338-b007-46ce-8e20-666689bb9b4d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:23.152928 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c41cd338-b007-46ce-8e20-666689bb9b4d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:23.153368 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c41cd338-b007-46ce-8e20-666689bb9b4d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:23.154139 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c41cd338-b007-46ce-8e20-666689bb9b4d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:23.154603 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c41cd338-b007-46ce-8e20-666689bb9b4d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:23.312691 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-c41cd338-b007-46ce-8e20-666689bb9b4d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:23.321576 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-c41cd338-b007-46ce-8e20-666689bb9b4d tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.179517 Nov 16 00:32:23.322164 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 272/544] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:23 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:23.428693 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-e3436936-5346-4acf-b0d6-5a2406d12cec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:23.430379 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-e3436936-5346-4acf-b0d6-5a2406d12cec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:23.438655 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e3436936-5346-4acf-b0d6-5a2406d12cec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:23.439171 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e3436936-5346-4acf-b0d6-5a2406d12cec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:23.440039 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e3436936-5346-4acf-b0d6-5a2406d12cec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:23.440520 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e3436936-5346-4acf-b0d6-5a2406d12cec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:23.482984 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-98164c02-89e9-419a-befb-7e3c6c1d7015 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:23.484749 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-98164c02-89e9-419a-befb-7e3c6c1d7015 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:23.501983 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-98164c02-89e9-419a-befb-7e3c6c1d7015 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:23.502723 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-98164c02-89e9-419a-befb-7e3c6c1d7015 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:23.504331 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-98164c02-89e9-419a-befb-7e3c6c1d7015 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:23.505170 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-98164c02-89e9-419a-befb-7e3c6c1d7015 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:23.628778 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e3436936-5346-4acf-b0d6-5a2406d12cec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:23.642904 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-e3436936-5346-4acf-b0d6-5a2406d12cec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1677 microversion: 2.1 time: 0.219017 Nov 16 00:32:23.643754 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 273/545] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:23 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1677 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:23.710276 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-98164c02-89e9-419a-befb-7e3c6c1d7015 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:23.720880 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-98164c02-89e9-419a-befb-7e3c6c1d7015 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:23.722890 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-98164c02-89e9-419a-befb-7e3c6c1d7015 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:23.723766 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-98164c02-89e9-419a-befb-7e3c6c1d7015 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.247536 Nov 16 00:32:23.724326 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 273/546] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:23 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:32:24.345590 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-b4a7bd68-9c3a-4edb-b33a-11dc2812eba1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:24.346035 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b4a7bd68-9c3a-4edb-b33a-11dc2812eba1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:24.352482 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b4a7bd68-9c3a-4edb-b33a-11dc2812eba1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:24.352932 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b4a7bd68-9c3a-4edb-b33a-11dc2812eba1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:24.353708 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b4a7bd68-9c3a-4edb-b33a-11dc2812eba1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:24.354141 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b4a7bd68-9c3a-4edb-b33a-11dc2812eba1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:24.502265 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-b4a7bd68-9c3a-4edb-b33a-11dc2812eba1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:24.511474 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-b4a7bd68-9c3a-4edb-b33a-11dc2812eba1 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.170043 Nov 16 00:32:24.512054 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 274/547] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:24 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:24.663237 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-26ddaba8-c2ae-4118-bcc7-8ead27f81fec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:24.664067 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-26ddaba8-c2ae-4118-bcc7-8ead27f81fec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:24.672034 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-26ddaba8-c2ae-4118-bcc7-8ead27f81fec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:24.672367 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-26ddaba8-c2ae-4118-bcc7-8ead27f81fec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:24.673205 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-26ddaba8-c2ae-4118-bcc7-8ead27f81fec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:24.673683 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-26ddaba8-c2ae-4118-bcc7-8ead27f81fec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:24.742570 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-baab6423-2cd3-42b2-bef2-6c3b86fa24ba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:24.743271 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-baab6423-2cd3-42b2-bef2-6c3b86fa24ba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:24.749689 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-baab6423-2cd3-42b2-bef2-6c3b86fa24ba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:24.750152 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-baab6423-2cd3-42b2-bef2-6c3b86fa24ba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:24.750968 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-baab6423-2cd3-42b2-bef2-6c3b86fa24ba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:24.751429 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-baab6423-2cd3-42b2-bef2-6c3b86fa24ba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:24.815495 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-26ddaba8-c2ae-4118-bcc7-8ead27f81fec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:24.824404 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-26ddaba8-c2ae-4118-bcc7-8ead27f81fec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1677 microversion: 2.1 time: 0.165620 Nov 16 00:32:24.824997 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 274/548] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:24 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:24.886242 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-baab6423-2cd3-42b2-bef2-6c3b86fa24ba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:24.896383 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-baab6423-2cd3-42b2-bef2-6c3b86fa24ba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:24.897993 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-baab6423-2cd3-42b2-bef2-6c3b86fa24ba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:24.899255 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-baab6423-2cd3-42b2-bef2-6c3b86fa24ba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.160482 Nov 16 00:32:24.899828 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 275/549] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:24 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:32:25.534335 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-40a06894-aad5-440b-990d-840242c78cd9 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:25.535486 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-40a06894-aad5-440b-990d-840242c78cd9 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:25.546631 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-40a06894-aad5-440b-990d-840242c78cd9 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:25.547722 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-40a06894-aad5-440b-990d-840242c78cd9 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:25.549173 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-40a06894-aad5-440b-990d-840242c78cd9 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:25.549959 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-40a06894-aad5-440b-990d-840242c78cd9 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:25.744321 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-40a06894-aad5-440b-990d-840242c78cd9 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0dcf62ea9db4f25a774090e59d726b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e424e3f6e1d448fb921f87b10aa1fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:25.753300 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-40a06894-aad5-440b-990d-840242c78cd9 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 200 len: 1520 microversion: 2.1 time: 0.225930 Nov 16 00:32:25.753775 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 275/550] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:25 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:25.843469 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c344bc85-39bc-4004-a4fb-13ce0016b922 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:25.844298 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c344bc85-39bc-4004-a4fb-13ce0016b922 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:25.851760 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c344bc85-39bc-4004-a4fb-13ce0016b922 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:25.852174 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c344bc85-39bc-4004-a4fb-13ce0016b922 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:25.856809 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c344bc85-39bc-4004-a4fb-13ce0016b922 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:25.859471 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c344bc85-39bc-4004-a4fb-13ce0016b922 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:25.931371 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-c9889b36-94cb-4e12-bf11-18e37cce9778 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:25.933998 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-c9889b36-94cb-4e12-bf11-18e37cce9778 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:25.963072 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c9889b36-94cb-4e12-bf11-18e37cce9778 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:25.965625 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c9889b36-94cb-4e12-bf11-18e37cce9778 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:25.969370 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c9889b36-94cb-4e12-bf11-18e37cce9778 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:25.969885 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c9889b36-94cb-4e12-bf11-18e37cce9778 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:26.159418 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c344bc85-39bc-4004-a4fb-13ce0016b922 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:26.173074 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c344bc85-39bc-4004-a4fb-13ce0016b922 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1677 microversion: 2.1 time: 0.333274 Nov 16 00:32:26.174804 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 276/551] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:25 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1677 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:26.185824 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-164fd687-714e-44d0-a2e7-78b128ec1a82 req-d13d25c8-ed04-47be-af53-81887985d39e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "896600e3-829b-43f9-87af-60d271f05432", "name": "network-vif-deleted", "tag": "c1f88a1d-9b68-4cbe-84d4-91309b1307d6"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:32:26.190012 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-c9889b36-94cb-4e12-bf11-18e37cce9778 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:26.192323 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:32:26.192323 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:32:26.204250 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-c9889b36-94cb-4e12-bf11-18e37cce9778 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:26.205990 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-c9889b36-94cb-4e12-bf11-18e37cce9778 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:26.206871 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-164fd687-714e-44d0-a2e7-78b128ec1a82 req-d13d25c8-ed04-47be-af53-81887985d39e service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:26.207670 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-164fd687-714e-44d0-a2e7-78b128ec1a82 req-d13d25c8-ed04-47be-af53-81887985d39e service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:26.208457 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-c9889b36-94cb-4e12-bf11-18e37cce9778 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.292121 Nov 16 00:32:26.209868 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 276/552] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:25 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:32:26.228622 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-014f88ad-2bec-408b-8392-71e6829c6083 req-3e06536b-81c9-4635-aa67-41c75eca66d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f9b823f-75c2-4baf-9577-5dc85ec77405", "name": "network-vif-plugged", "status": "completed", "tag": "10abc4a6-a723-4a5c-855b-11d4b6d40eb9"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:32:26.231526 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:32:26.231526 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:32:26.232141 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-164fd687-714e-44d0-a2e7-78b128ec1a82 req-d13d25c8-ed04-47be-af53-81887985d39e service nova] Creating event network-vif-deleted:c1f88a1d-9b68-4cbe-84d4-91309b1307d6 for instance 896600e3-829b-43f9-87af-60d271f05432 on hv-cinder-81115 Nov 16 00:32:26.244338 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-164fd687-714e-44d0-a2e7-78b128ec1a82 req-d13d25c8-ed04-47be-af53-81887985d39e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067053 Nov 16 00:32:26.245839 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 277/553] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:32:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:32:26.268312 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-014f88ad-2bec-408b-8392-71e6829c6083 req-3e06536b-81c9-4635-aa67-41c75eca66d6 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:26.270943 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-014f88ad-2bec-408b-8392-71e6829c6083 req-3e06536b-81c9-4635-aa67-41c75eca66d6 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:26.298587 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-014f88ad-2bec-408b-8392-71e6829c6083 req-3e06536b-81c9-4635-aa67-41c75eca66d6 service nova] Creating event network-vif-plugged:10abc4a6-a723-4a5c-855b-11d4b6d40eb9 for instance 3f9b823f-75c2-4baf-9577-5dc85ec77405 on hv-cinder-81115 Nov 16 00:32:26.307933 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-014f88ad-2bec-408b-8392-71e6829c6083 req-3e06536b-81c9-4635-aa67-41c75eca66d6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083082 Nov 16 00:32:26.309071 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 277/554] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:32:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:32:26.774294 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-5543e324-38d8-4bc3-b5e4-d41c34ce1c87 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:26.775479 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-5543e324-38d8-4bc3-b5e4-d41c34ce1c87 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] [instance: 896600e3-829b-43f9-87af-60d271f05432] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:26.786488 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5543e324-38d8-4bc3-b5e4-d41c34ce1c87 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:26.787543 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5543e324-38d8-4bc3-b5e4-d41c34ce1c87 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:26.788934 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5543e324-38d8-4bc3-b5e4-d41c34ce1c87 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:26.789537 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5543e324-38d8-4bc3-b5e4-d41c34ce1c87 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:26.810455 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-5543e324-38d8-4bc3-b5e4-d41c34ce1c87 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] HTTP exception thrown: Instance 896600e3-829b-43f9-87af-60d271f05432 could not be found. Nov 16 00:32:26.811527 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-5543e324-38d8-4bc3-b5e4-d41c34ce1c87 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] Returning 404 to user: Instance 896600e3-829b-43f9-87af-60d271f05432 could not be found. {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:32:26.812603 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-5543e324-38d8-4bc3-b5e4-d41c34ce1c87 tempest-ServerRescueNegativeTestJSON-1592611832 tempest-ServerRescueNegativeTestJSON-1592611832-project] 10.222.0.31 "GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432" status: 404 len: 111 microversion: 2.1 time: 0.045191 Nov 16 00:32:26.813380 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 278/555] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:26 2021] GET /compute/v2.1/servers/896600e3-829b-43f9-87af-60d271f05432 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:32:27.201709 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-64ed0000-133b-47ac-b912-38128fa01ca7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:27.202759 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-64ed0000-133b-47ac-b912-38128fa01ca7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:27.209972 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-64ed0000-133b-47ac-b912-38128fa01ca7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:27.210509 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-64ed0000-133b-47ac-b912-38128fa01ca7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:27.211345 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-64ed0000-133b-47ac-b912-38128fa01ca7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:27.211772 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-64ed0000-133b-47ac-b912-38128fa01ca7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:27.242991 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-63039a08-fdbc-4a9a-b002-9c5751781a78 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:27.244578 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-63039a08-fdbc-4a9a-b002-9c5751781a78 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:27.252908 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-63039a08-fdbc-4a9a-b002-9c5751781a78 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:27.253342 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-63039a08-fdbc-4a9a-b002-9c5751781a78 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:27.254640 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-63039a08-fdbc-4a9a-b002-9c5751781a78 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:27.255267 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-63039a08-fdbc-4a9a-b002-9c5751781a78 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:27.448239 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-63039a08-fdbc-4a9a-b002-9c5751781a78 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:27.460372 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-63039a08-fdbc-4a9a-b002-9c5751781a78 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:27.462834 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-63039a08-fdbc-4a9a-b002-9c5751781a78 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:27.464470 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-63039a08-fdbc-4a9a-b002-9c5751781a78 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.225768 Nov 16 00:32:27.465307 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 279/556] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:27 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:32:27.663775 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-87d5e9b0-2720-49d3-b12c-8155dbfa1f5f tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:27.664575 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-87d5e9b0-2720-49d3-b12c-8155dbfa1f5f tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:27.683132 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-87d5e9b0-2720-49d3-b12c-8155dbfa1f5f tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:27.683489 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-87d5e9b0-2720-49d3-b12c-8155dbfa1f5f tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:27.684315 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-87d5e9b0-2720-49d3-b12c-8155dbfa1f5f tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:27.684753 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-87d5e9b0-2720-49d3-b12c-8155dbfa1f5f tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:27.870395 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-87d5e9b0-2720-49d3-b12c-8155dbfa1f5f tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:27.879371 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-87d5e9b0-2720-49d3-b12c-8155dbfa1f5f tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1595 microversion: 2.1 time: 0.219685 Nov 16 00:32:27.880080 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 280/557] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:27 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1595 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:27.918871 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-64ed0000-133b-47ac-b912-38128fa01ca7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:27.953888 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-64ed0000-133b-47ac-b912-38128fa01ca7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1677 microversion: 2.1 time: 0.756751 Nov 16 00:32:27.955171 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 278/558] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:27 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1677 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:28.494439 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-448caeec-4872-45c1-9dab-409f142ab14b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:28.495914 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-448caeec-4872-45c1-9dab-409f142ab14b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:28.504335 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-448caeec-4872-45c1-9dab-409f142ab14b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:28.505297 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-448caeec-4872-45c1-9dab-409f142ab14b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:28.506327 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-448caeec-4872-45c1-9dab-409f142ab14b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:28.506982 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-448caeec-4872-45c1-9dab-409f142ab14b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:28.858074 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-448caeec-4872-45c1-9dab-409f142ab14b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:28.883650 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-448caeec-4872-45c1-9dab-409f142ab14b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:28.888556 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-448caeec-4872-45c1-9dab-409f142ab14b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:28.892662 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-448caeec-4872-45c1-9dab-409f142ab14b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1806 microversion: 2.20 time: 0.401828 Nov 16 00:32:28.894366 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 281/559] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:28 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1806 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:32:28.979793 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-33b60759-7737-4a8d-a0ac-0211941cfa93 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:28.988809 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-33b60759-7737-4a8d-a0ac-0211941cfa93 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:29.011480 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-33b60759-7737-4a8d-a0ac-0211941cfa93 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:29.013875 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-33b60759-7737-4a8d-a0ac-0211941cfa93 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:29.017914 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-33b60759-7737-4a8d-a0ac-0211941cfa93 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:29.019107 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-33b60759-7737-4a8d-a0ac-0211941cfa93 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:29.464986 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-33b60759-7737-4a8d-a0ac-0211941cfa93 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:29.485787 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-33b60759-7737-4a8d-a0ac-0211941cfa93 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1654 microversion: 2.1 time: 0.514528 Nov 16 00:32:29.487087 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 279/560] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:28 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1654 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:29.515920 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8aefd886-002f-4823-9923-a6ca4f592670 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:32:29.524960 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8aefd886-002f-4823-9923-a6ca4f592670 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:29.525486 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8aefd886-002f-4823-9923-a6ca4f592670 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:29.570057 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8aefd886-002f-4823-9923-a6ca4f592670 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Going to try to start instance {{(pid=122543) start /opt/stack/nova/nova/compute/api.py:2675}} Nov 16 00:32:29.644934 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8aefd886-002f-4823-9923-a6ca4f592670 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action" status: 202 len: 0 microversion: 2.1 time: 0.130517 Nov 16 00:32:29.646533 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 282/561] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:32:29 2021] POST /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:32:29.657422 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a487b8b9-663c-41ff-bc6f-1b28176c31f9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:29.658146 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a487b8b9-663c-41ff-bc6f-1b28176c31f9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:29.667682 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a487b8b9-663c-41ff-bc6f-1b28176c31f9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:29.668658 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a487b8b9-663c-41ff-bc6f-1b28176c31f9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:29.670081 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a487b8b9-663c-41ff-bc6f-1b28176c31f9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:29.670723 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a487b8b9-663c-41ff-bc6f-1b28176c31f9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:29.933034 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-33bb9f88-2d18-43be-8600-03370d7271a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:29.933255 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-33bb9f88-2d18-43be-8600-03370d7271a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:29.950961 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-33bb9f88-2d18-43be-8600-03370d7271a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:29.952658 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-33bb9f88-2d18-43be-8600-03370d7271a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:29.955666 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-33bb9f88-2d18-43be-8600-03370d7271a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:29.956784 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-33bb9f88-2d18-43be-8600-03370d7271a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:30.065816 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a487b8b9-663c-41ff-bc6f-1b28176c31f9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:30.075363 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a487b8b9-663c-41ff-bc6f-1b28176c31f9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1663 microversion: 2.1 time: 0.422840 Nov 16 00:32:30.076160 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 280/562] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:29 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1663 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:30.693460 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-33bb9f88-2d18-43be-8600-03370d7271a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:30.713758 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-33bb9f88-2d18-43be-8600-03370d7271a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:30.716603 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-33bb9f88-2d18-43be-8600-03370d7271a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:30.718352 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-33bb9f88-2d18-43be-8600-03370d7271a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1793 microversion: 2.20 time: 0.799407 Nov 16 00:32:30.719593 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 283/563] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:32:29 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1793 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:32:31.098517 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-dbdba345-acc6-41bf-b140-483b1a1f0751 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:31.099893 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-dbdba345-acc6-41bf-b140-483b1a1f0751 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:31.116104 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dbdba345-acc6-41bf-b140-483b1a1f0751 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:31.116561 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dbdba345-acc6-41bf-b140-483b1a1f0751 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:31.117433 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dbdba345-acc6-41bf-b140-483b1a1f0751 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:31.117878 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dbdba345-acc6-41bf-b140-483b1a1f0751 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:31.267012 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-d6f5b6e7-a208-4d86-b71c-030abe5d9d5b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1355762011", "imageRef": "bb47ca05-3b48-4f1c-bc96-e0c5c672caba", "flavorRef": "452", "networks": [{"uuid": "5bc8079a-b087-4e35-8fba-022dbaf3b750"}]}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:32:31.399310 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.network.neutron [None req-d6f5b6e7-a208-4d86-b71c-030abe5d9d5b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] validate_networks() for [('5bc8079a-b087-4e35-8fba-022dbaf3b750', None, None, None, None, None)] {{(pid=122543) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:32:31.488201 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-dbdba345-acc6-41bf-b140-483b1a1f0751 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:31.511199 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-dbdba345-acc6-41bf-b140-483b1a1f0751 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1663 microversion: 2.1 time: 0.416105 Nov 16 00:32:31.513462 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 281/564] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:31 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1663 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:32.500929 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-d6f5b6e7-a208-4d86-b71c-030abe5d9d5b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Flavor limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:32:32.501769 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-d6f5b6e7-a208-4d86-b71c-030abe5d9d5b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Image limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:32:32.501945 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-d6f5b6e7-a208-4d86-b71c-030abe5d9d5b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Flavor pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:32:32.502716 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-d6f5b6e7-a208-4d86-b71c-030abe5d9d5b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Image pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:32:32.503558 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-d6f5b6e7-a208-4d86-b71c-030abe5d9d5b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:32:32.516650 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d6f5b6e7-a208-4d86-b71c-030abe5d9d5b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:32.518530 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d6f5b6e7-a208-4d86-b71c-030abe5d9d5b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:32.520029 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d6f5b6e7-a208-4d86-b71c-030abe5d9d5b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:32.520659 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d6f5b6e7-a208-4d86-b71c-030abe5d9d5b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:32.540898 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-649133c9-5620-4e72-8621-7eb81eeb7a54 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:32.542817 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-649133c9-5620-4e72-8621-7eb81eeb7a54 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:32.546597 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-d6f5b6e7-a208-4d86-b71c-030abe5d9d5b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Getting quotas for project 4ea54a26354e40baac7af6061517ccf4. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:32:32.551369 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-d6f5b6e7-a208-4d86-b71c-030abe5d9d5b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Getting quotas for user dc4b2e84db43455d843f4b322fae785e and project 4ea54a26354e40baac7af6061517ccf4. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:32:32.557712 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-649133c9-5620-4e72-8621-7eb81eeb7a54 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:32.558894 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-649133c9-5620-4e72-8621-7eb81eeb7a54 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:32.560585 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-649133c9-5620-4e72-8621-7eb81eeb7a54 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:32.563303 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-649133c9-5620-4e72-8621-7eb81eeb7a54 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:32.570749 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d6f5b6e7-a208-4d86-b71c-030abe5d9d5b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Going to run 1 instances... {{(pid=122543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:32:32.573221 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d6f5b6e7-a208-4d86-b71c-030abe5d9d5b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: ff1f1755-bb14-4be4-90be-c9b32692635d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb47ca05-3b48-4f1c-bc96-e0c5c672caba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:32:32.648288 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-d6f5b6e7-a208-4d86-b71c-030abe5d9d5b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.385511 Nov 16 00:32:32.656997 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 284/565] 10.222.0.31 () {60 vars in 1146 bytes} [Tue Nov 16 00:32:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 16 00:32:32.668586 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-154fc7da-ba7a-447f-a9d8-b00d7af516c2 req-d183747a-6c1f-455b-aba1-e796d9c49655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81", "tag": "766ca728-c4c6-4a74-b3aa-0075802cbf56"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:32:32.674525 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:32:32.674525 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:32:32.689311 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-154fc7da-ba7a-447f-a9d8-b00d7af516c2 req-d183747a-6c1f-455b-aba1-e796d9c49655 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:32.690011 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-154fc7da-ba7a-447f-a9d8-b00d7af516c2 req-d183747a-6c1f-455b-aba1-e796d9c49655 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:32.702567 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-154fc7da-ba7a-447f-a9d8-b00d7af516c2 req-d183747a-6c1f-455b-aba1-e796d9c49655 service nova] Creating event network-changed:766ca728-c4c6-4a74-b3aa-0075802cbf56 for instance 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 on hv-cinder-81115 Nov 16 00:32:32.708425 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-154fc7da-ba7a-447f-a9d8-b00d7af516c2 req-d183747a-6c1f-455b-aba1-e796d9c49655 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049501 Nov 16 00:32:32.709851 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 285/566] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:32:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:32:32.716619 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-46bc6441-d2f4-4ba5-a943-fe7d344bdd97 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:32.717573 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-46bc6441-d2f4-4ba5-a943-fe7d344bdd97 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: ff1f1755-bb14-4be4-90be-c9b32692635d] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:32.830729 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-46bc6441-d2f4-4ba5-a943-fe7d344bdd97 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:32.843038 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-46bc6441-d2f4-4ba5-a943-fe7d344bdd97 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d" status: 200 len: 1219 microversion: 2.1 time: 0.130009 Nov 16 00:32:32.856898 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 286/567] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:32 2021] GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d => generated 1219 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:32.972323 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-649133c9-5620-4e72-8621-7eb81eeb7a54 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:32.982023 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-649133c9-5620-4e72-8621-7eb81eeb7a54 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1667 microversion: 2.1 time: 0.448380 Nov 16 00:32:32.983948 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 282/568] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:32 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1667 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:33.873796 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-36c9062f-9f0c-4d10-a5d4-adb7ced91775 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:33.875155 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-36c9062f-9f0c-4d10-a5d4-adb7ced91775 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: ff1f1755-bb14-4be4-90be-c9b32692635d] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:33.884866 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-36c9062f-9f0c-4d10-a5d4-adb7ced91775 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:33.885310 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-36c9062f-9f0c-4d10-a5d4-adb7ced91775 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:33.891942 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-36c9062f-9f0c-4d10-a5d4-adb7ced91775 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:33.894504 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-36c9062f-9f0c-4d10-a5d4-adb7ced91775 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:34.029664 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-36c9062f-9f0c-4d10-a5d4-adb7ced91775 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:34.058456 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-36c9062f-9f0c-4d10-a5d4-adb7ced91775 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d" status: 200 len: 1215 microversion: 2.1 time: 0.188119 Nov 16 00:32:34.066685 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 287/569] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:33 2021] GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d => generated 1215 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:34.821456 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0ff313dc-234a-467a-918a-c111022f597a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1536369284"}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:32:34.822229 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0ff313dc-234a-467a-918a-c111022f597a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:34.830874 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0ff313dc-234a-467a-918a-c111022f597a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:34.831844 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0ff313dc-234a-467a-918a-c111022f597a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:34.832690 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0ff313dc-234a-467a-918a-c111022f597a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:34.833083 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0ff313dc-234a-467a-918a-c111022f597a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:35.003621 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.network.security_group_api [None req-0ff313dc-234a-467a-918a-c111022f597a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Adding security group ee0dc591-4647-4bb0-b605-bcaf54f2684a to port 766ca728-c4c6-4a74-b3aa-0075802cbf56 Nov 16 00:32:35.087579 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-07bc768c-cfef-4fdd-b5b8-45c24bd49168 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:35.089390 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-07bc768c-cfef-4fdd-b5b8-45c24bd49168 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: ff1f1755-bb14-4be4-90be-c9b32692635d] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:35.096441 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-07bc768c-cfef-4fdd-b5b8-45c24bd49168 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:35.097183 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-07bc768c-cfef-4fdd-b5b8-45c24bd49168 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:35.098104 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-07bc768c-cfef-4fdd-b5b8-45c24bd49168 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:35.098693 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-07bc768c-cfef-4fdd-b5b8-45c24bd49168 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:35.195983 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-07bc768c-cfef-4fdd-b5b8-45c24bd49168 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:35.211263 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-07bc768c-cfef-4fdd-b5b8-45c24bd49168 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d" status: 200 len: 1277 microversion: 2.1 time: 0.129761 Nov 16 00:32:35.213010 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 288/570] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:35 2021] GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d => generated 1277 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:35.630807 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0ff313dc-234a-467a-918a-c111022f597a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "POST /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81/action" status: 202 len: 0 microversion: 2.1 time: 0.813562 Nov 16 00:32:35.631461 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 283/571] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:32:34 2021] POST /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81/action => generated 0 bytes in 815 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:32:35.640118 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f1ef3889-290a-4d01-9b38-f081a8cbb82c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:35.640927 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f1ef3889-290a-4d01-9b38-f081a8cbb82c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:35.652828 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f1ef3889-290a-4d01-9b38-f081a8cbb82c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:35.654594 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f1ef3889-290a-4d01-9b38-f081a8cbb82c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:35.654757 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-3017b250-4cd5-4faa-bfaf-e32223789192 req-558d36b3-8035-4984-81e1-91ea9807af46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81", "tag": "766ca728-c4c6-4a74-b3aa-0075802cbf56"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:32:35.656659 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f1ef3889-290a-4d01-9b38-f081a8cbb82c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:35.657386 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:32:35.657386 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:32:35.657998 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f1ef3889-290a-4d01-9b38-f081a8cbb82c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:35.670463 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-3017b250-4cd5-4faa-bfaf-e32223789192 req-558d36b3-8035-4984-81e1-91ea9807af46 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:35.675415 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-3017b250-4cd5-4faa-bfaf-e32223789192 req-558d36b3-8035-4984-81e1-91ea9807af46 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:35.695909 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-3017b250-4cd5-4faa-bfaf-e32223789192 req-558d36b3-8035-4984-81e1-91ea9807af46 service nova] Creating event network-changed:766ca728-c4c6-4a74-b3aa-0075802cbf56 for instance 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 on hv-cinder-81115 Nov 16 00:32:35.710196 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-3017b250-4cd5-4faa-bfaf-e32223789192 req-558d36b3-8035-4984-81e1-91ea9807af46 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058844 Nov 16 00:32:35.713912 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 284/572] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:32:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:32:36.060829 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f1ef3889-290a-4d01-9b38-f081a8cbb82c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:36.072673 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f1ef3889-290a-4d01-9b38-f081a8cbb82c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1761 microversion: 2.1 time: 0.436577 Nov 16 00:32:36.076472 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 289/573] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:35 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1761 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:36.241373 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0aa34223-9e35-42fe-ae0c-d14c7863188b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:36.244786 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0aa34223-9e35-42fe-ae0c-d14c7863188b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: ff1f1755-bb14-4be4-90be-c9b32692635d] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:36.252524 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0aa34223-9e35-42fe-ae0c-d14c7863188b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:36.253256 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0aa34223-9e35-42fe-ae0c-d14c7863188b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:36.254205 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0aa34223-9e35-42fe-ae0c-d14c7863188b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:36.254794 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0aa34223-9e35-42fe-ae0c-d14c7863188b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:36.514465 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0aa34223-9e35-42fe-ae0c-d14c7863188b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:36.524690 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0aa34223-9e35-42fe-ae0c-d14c7863188b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d" status: 200 len: 1319 microversion: 2.1 time: 0.288155 Nov 16 00:32:36.525866 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 285/574] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:36 2021] GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:36.884968 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-1c268d92-ea8f-454d-be37-894944159235 req-1b008915-2ef6-4741-a43f-c2500b2dd022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff1f1755-bb14-4be4-90be-c9b32692635d", "tag": "179c647c-5bc4-406a-80f8-784a650a92d9"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:32:36.888064 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:32:36.888064 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:32:36.899607 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-1c268d92-ea8f-454d-be37-894944159235 req-1b008915-2ef6-4741-a43f-c2500b2dd022 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:36.900207 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-1c268d92-ea8f-454d-be37-894944159235 req-1b008915-2ef6-4741-a43f-c2500b2dd022 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:36.918388 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-1c268d92-ea8f-454d-be37-894944159235 req-1b008915-2ef6-4741-a43f-c2500b2dd022 service nova] Creating event network-changed:179c647c-5bc4-406a-80f8-784a650a92d9 for instance ff1f1755-bb14-4be4-90be-c9b32692635d on hv-cinder-81115 Nov 16 00:32:36.923493 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-1c268d92-ea8f-454d-be37-894944159235 req-1b008915-2ef6-4741-a43f-c2500b2dd022 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052589 Nov 16 00:32:36.924457 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 290/575] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:32:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:32:37.555007 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0ad83e2c-7a68-4e26-9f85-7ca290c66a90 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:37.556276 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0ad83e2c-7a68-4e26-9f85-7ca290c66a90 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: ff1f1755-bb14-4be4-90be-c9b32692635d] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:37.563228 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0ad83e2c-7a68-4e26-9f85-7ca290c66a90 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:37.563994 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0ad83e2c-7a68-4e26-9f85-7ca290c66a90 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:37.564828 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0ad83e2c-7a68-4e26-9f85-7ca290c66a90 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:37.565455 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0ad83e2c-7a68-4e26-9f85-7ca290c66a90 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:37.730377 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0ad83e2c-7a68-4e26-9f85-7ca290c66a90 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:37.750218 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0ad83e2c-7a68-4e26-9f85-7ca290c66a90 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d" status: 200 len: 1319 microversion: 2.1 time: 0.198393 Nov 16 00:32:37.752357 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 286/576] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:37 2021] GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:38.769820 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-3f61b37c-ea04-49be-8b3b-3d474740efe1 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:38.770517 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-3f61b37c-ea04-49be-8b3b-3d474740efe1 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: ff1f1755-bb14-4be4-90be-c9b32692635d] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:38.777043 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3f61b37c-ea04-49be-8b3b-3d474740efe1 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:38.777481 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3f61b37c-ea04-49be-8b3b-3d474740efe1 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:38.778256 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3f61b37c-ea04-49be-8b3b-3d474740efe1 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:38.778680 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3f61b37c-ea04-49be-8b3b-3d474740efe1 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:38.970028 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-3f61b37c-ea04-49be-8b3b-3d474740efe1 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:38.977920 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-3f61b37c-ea04-49be-8b3b-3d474740efe1 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d" status: 200 len: 1319 microversion: 2.1 time: 0.212425 Nov 16 00:32:38.978718 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 291/577] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:38 2021] GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:39.995290 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0914981b-8d5c-4103-9162-342846815812 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:39.996598 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0914981b-8d5c-4103-9162-342846815812 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: ff1f1755-bb14-4be4-90be-c9b32692635d] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:40.003482 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0914981b-8d5c-4103-9162-342846815812 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:40.004210 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0914981b-8d5c-4103-9162-342846815812 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:40.004977 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0914981b-8d5c-4103-9162-342846815812 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:40.005400 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0914981b-8d5c-4103-9162-342846815812 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:40.176991 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0914981b-8d5c-4103-9162-342846815812 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:40.185317 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0914981b-8d5c-4103-9162-342846815812 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d" status: 200 len: 1319 microversion: 2.1 time: 0.193679 Nov 16 00:32:40.185475 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 287/578] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:39 2021] GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:41.201965 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-5ee31e64-4add-4d66-9b74-06b22ed03e45 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:41.203471 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-5ee31e64-4add-4d66-9b74-06b22ed03e45 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: ff1f1755-bb14-4be4-90be-c9b32692635d] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:41.209432 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5ee31e64-4add-4d66-9b74-06b22ed03e45 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:41.209875 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5ee31e64-4add-4d66-9b74-06b22ed03e45 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:41.210655 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5ee31e64-4add-4d66-9b74-06b22ed03e45 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:41.211107 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5ee31e64-4add-4d66-9b74-06b22ed03e45 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:41.351338 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-5ee31e64-4add-4d66-9b74-06b22ed03e45 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:41.359656 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-5ee31e64-4add-4d66-9b74-06b22ed03e45 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d" status: 200 len: 1319 microversion: 2.1 time: 0.161282 Nov 16 00:32:41.360242 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 292/579] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:41 2021] GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:42.062923 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-b9132d77-1a6d-4cc9-9aa1-2c37a9c9850c req-7c4f8334-4c04-4465-af2f-c4b4716ebed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1f1755-bb14-4be4-90be-c9b32692635d", "name": "network-vif-plugged", "status": "completed", "tag": "179c647c-5bc4-406a-80f8-784a650a92d9"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:32:42.065897 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:32:42.065897 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:32:42.079537 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-b9132d77-1a6d-4cc9-9aa1-2c37a9c9850c req-7c4f8334-4c04-4465-af2f-c4b4716ebed1 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:42.080493 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-b9132d77-1a6d-4cc9-9aa1-2c37a9c9850c req-7c4f8334-4c04-4465-af2f-c4b4716ebed1 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:42.095758 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-b9132d77-1a6d-4cc9-9aa1-2c37a9c9850c req-7c4f8334-4c04-4465-af2f-c4b4716ebed1 service nova] Creating event network-vif-plugged:179c647c-5bc4-406a-80f8-784a650a92d9 for instance ff1f1755-bb14-4be4-90be-c9b32692635d on hv-cinder-81115 Nov 16 00:32:42.101126 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-b9132d77-1a6d-4cc9-9aa1-2c37a9c9850c req-7c4f8334-4c04-4465-af2f-c4b4716ebed1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045229 Nov 16 00:32:42.102000 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 288/580] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:32:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:32:42.377550 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-20d5caa5-8160-435f-a8fe-c4b2cdc4834e tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:42.377985 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-20d5caa5-8160-435f-a8fe-c4b2cdc4834e tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: ff1f1755-bb14-4be4-90be-c9b32692635d] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:42.384190 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-20d5caa5-8160-435f-a8fe-c4b2cdc4834e tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:42.384770 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-20d5caa5-8160-435f-a8fe-c4b2cdc4834e tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:42.385554 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-20d5caa5-8160-435f-a8fe-c4b2cdc4834e tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:42.385991 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-20d5caa5-8160-435f-a8fe-c4b2cdc4834e tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:42.519566 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-20d5caa5-8160-435f-a8fe-c4b2cdc4834e tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:42.527230 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-20d5caa5-8160-435f-a8fe-c4b2cdc4834e tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d" status: 200 len: 1319 microversion: 2.1 time: 0.154475 Nov 16 00:32:42.527753 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 293/581] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:42 2021] GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:32:43.545903 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-334e45b4-53eb-41ed-984c-f3a7c8ff051d tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:43.546925 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-334e45b4-53eb-41ed-984c-f3a7c8ff051d tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: ff1f1755-bb14-4be4-90be-c9b32692635d] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:43.553961 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-334e45b4-53eb-41ed-984c-f3a7c8ff051d tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:43.554402 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-334e45b4-53eb-41ed-984c-f3a7c8ff051d tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:43.555205 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-334e45b4-53eb-41ed-984c-f3a7c8ff051d tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:43.555633 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-334e45b4-53eb-41ed-984c-f3a7c8ff051d tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:43.699432 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-334e45b4-53eb-41ed-984c-f3a7c8ff051d tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:43.708173 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-334e45b4-53eb-41ed-984c-f3a7c8ff051d tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d" status: 200 len: 1319 microversion: 2.1 time: 0.166230 Nov 16 00:32:43.708815 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 289/582] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:43 2021] GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:32:44.725735 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-901d7f91-d73f-43f1-ab55-feb4d1962134 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:32:44.726419 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-901d7f91-d73f-43f1-ab55-feb4d1962134 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: ff1f1755-bb14-4be4-90be-c9b32692635d] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:32:44.732176 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-901d7f91-d73f-43f1-ab55-feb4d1962134 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:44.732693 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-901d7f91-d73f-43f1-ab55-feb4d1962134 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:44.733889 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-901d7f91-d73f-43f1-ab55-feb4d1962134 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:32:44.734321 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-901d7f91-d73f-43f1-ab55-feb4d1962134 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:32:44.870497 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-901d7f91-d73f-43f1-ab55-feb4d1962134 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:32:44.878980 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-901d7f91-d73f-43f1-ab55-feb4d1962134 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d" status: 200 len: 1508 microversion: 2.1 time: 0.157100 Nov 16 00:32:44.879756 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 294/583] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:32:44 2021] GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:05.174088 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-6b5df0f5-c367-40ba-be8a-1c62549f31de tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:05.174644 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-6b5df0f5-c367-40ba-be8a-1c62549f31de tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:05.180991 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6b5df0f5-c367-40ba-be8a-1c62549f31de tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:05.181445 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6b5df0f5-c367-40ba-be8a-1c62549f31de tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:05.182221 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6b5df0f5-c367-40ba-be8a-1c62549f31de tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:05.182728 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6b5df0f5-c367-40ba-be8a-1c62549f31de tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:05.211990 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-6b5df0f5-c367-40ba-be8a-1c62549f31de tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Going to try to terminate instance {{(pid=122544) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:33:05.297783 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-6b5df0f5-c367-40ba-be8a-1c62549f31de tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 204 len: 0 microversion: 2.1 time: 0.126979 Nov 16 00:33:05.298824 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 290/584] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:33:05 2021] DELETE /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 16 00:33:05.313666 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-0be08293-5f9f-4c59-9c8f-dc53d0fac532 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:05.314306 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-0be08293-5f9f-4c59-9c8f-dc53d0fac532 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:05.321377 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0be08293-5f9f-4c59-9c8f-dc53d0fac532 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:05.321825 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0be08293-5f9f-4c59-9c8f-dc53d0fac532 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:05.322615 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0be08293-5f9f-4c59-9c8f-dc53d0fac532 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:05.323154 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0be08293-5f9f-4c59-9c8f-dc53d0fac532 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:05.329063 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-fec37bd6-43d7-4184-a0ce-24c5b32851ed tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:05.330681 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-fec37bd6-43d7-4184-a0ce-24c5b32851ed tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:05.339690 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-fec37bd6-43d7-4184-a0ce-24c5b32851ed tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:05.340125 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-fec37bd6-43d7-4184-a0ce-24c5b32851ed tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:05.341450 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-fec37bd6-43d7-4184-a0ce-24c5b32851ed tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:05.342108 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-fec37bd6-43d7-4184-a0ce-24c5b32851ed tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:05.436318 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-fec37bd6-43d7-4184-a0ce-24c5b32851ed tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "POST /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81/action" status: 202 len: 0 microversion: 2.1 time: 0.114108 Nov 16 00:33:05.437282 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 291/585] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:33:05 2021] POST /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:33:05.446633 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-6650c902-17ca-4a2a-a5fb-05c861ea1392 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:05.447370 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-6650c902-17ca-4a2a-a5fb-05c861ea1392 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:05.456263 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6650c902-17ca-4a2a-a5fb-05c861ea1392 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:05.457395 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6650c902-17ca-4a2a-a5fb-05c861ea1392 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:05.457773 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6650c902-17ca-4a2a-a5fb-05c861ea1392 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:05.458199 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6650c902-17ca-4a2a-a5fb-05c861ea1392 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:05.466687 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-0be08293-5f9f-4c59-9c8f-dc53d0fac532 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:05.476792 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-0be08293-5f9f-4c59-9c8f-dc53d0fac532 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1578 microversion: 2.1 time: 0.166992 Nov 16 00:33:05.477367 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 295/586] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:05 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:05.488523 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-94497540-439d-4512-bfd8-354d73f21d2a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c7071d8-5871-486f-ade5-808f890e6b63", "device": "/dev/sdb"}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:05.490937 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-94497540-439d-4512-bfd8-354d73f21d2a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: ff1f1755-bb14-4be4-90be-c9b32692635d] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:05.497587 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-94497540-439d-4512-bfd8-354d73f21d2a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:05.498029 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-94497540-439d-4512-bfd8-354d73f21d2a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:05.498803 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-94497540-439d-4512-bfd8-354d73f21d2a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:05.499288 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-94497540-439d-4512-bfd8-354d73f21d2a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:05.613334 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-6650c902-17ca-4a2a-a5fb-05c861ea1392 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:05.624804 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-6650c902-17ca-4a2a-a5fb-05c861ea1392 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1753 microversion: 2.1 time: 0.182226 Nov 16 00:33:05.627103 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 292/587] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:05 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1753 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:05.795655 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-94497540-439d-4512-bfd8-354d73f21d2a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "POST /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310927 Nov 16 00:33:05.796666 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 296/588] 10.222.0.31 () {60 vars in 1322 bytes} [Tue Nov 16 00:33:05 2021] POST /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:33:06.496723 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-dd6ed250-3b21-4a5b-b0a4-dea2aa7d0e6e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:06.497331 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-dd6ed250-3b21-4a5b-b0a4-dea2aa7d0e6e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:06.507193 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dd6ed250-3b21-4a5b-b0a4-dea2aa7d0e6e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:06.507193 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dd6ed250-3b21-4a5b-b0a4-dea2aa7d0e6e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:06.507193 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dd6ed250-3b21-4a5b-b0a4-dea2aa7d0e6e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:06.507193 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dd6ed250-3b21-4a5b-b0a4-dea2aa7d0e6e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:06.644862 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8847673a-41ca-4eb3-a166-d2a1973035b0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:06.645726 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8847673a-41ca-4eb3-a166-d2a1973035b0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:06.648629 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-dd6ed250-3b21-4a5b-b0a4-dea2aa7d0e6e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:06.652417 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8847673a-41ca-4eb3-a166-d2a1973035b0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:06.652864 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8847673a-41ca-4eb3-a166-d2a1973035b0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:06.653651 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8847673a-41ca-4eb3-a166-d2a1973035b0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:06.654115 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8847673a-41ca-4eb3-a166-d2a1973035b0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:06.656149 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-dd6ed250-3b21-4a5b-b0a4-dea2aa7d0e6e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1578 microversion: 2.1 time: 0.163166 Nov 16 00:33:06.657283 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 293/589] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:06 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:06.803278 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-8847673a-41ca-4eb3-a166-d2a1973035b0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:06.811360 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8847673a-41ca-4eb3-a166-d2a1973035b0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.171522 Nov 16 00:33:06.811923 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 297/590] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:06 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:07.675828 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-767c782e-362e-4336-be0e-9518e40db996 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:07.676720 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-767c782e-362e-4336-be0e-9518e40db996 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:07.682329 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-767c782e-362e-4336-be0e-9518e40db996 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:07.682767 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-767c782e-362e-4336-be0e-9518e40db996 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:07.683631 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-767c782e-362e-4336-be0e-9518e40db996 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:07.684062 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-767c782e-362e-4336-be0e-9518e40db996 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:07.826288 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-767c782e-362e-4336-be0e-9518e40db996 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:07.831091 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-255fc3d6-7e9d-4298-981d-03e3ae810d7a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:07.831785 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-255fc3d6-7e9d-4298-981d-03e3ae810d7a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:07.835791 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-767c782e-362e-4336-be0e-9518e40db996 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1578 microversion: 2.1 time: 0.164103 Nov 16 00:33:07.836398 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 294/591] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:07 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:07.841001 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-255fc3d6-7e9d-4298-981d-03e3ae810d7a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:07.841465 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-255fc3d6-7e9d-4298-981d-03e3ae810d7a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:07.842238 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-255fc3d6-7e9d-4298-981d-03e3ae810d7a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:07.842668 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-255fc3d6-7e9d-4298-981d-03e3ae810d7a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:08.112541 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-255fc3d6-7e9d-4298-981d-03e3ae810d7a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:08.122930 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-255fc3d6-7e9d-4298-981d-03e3ae810d7a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.297169 Nov 16 00:33:08.127233 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 298/592] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:07 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:08.643804 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-5d7aaf9f-c237-404e-9c95-0680398a0bd6 req-6c831c07-c4cf-4743-990c-411c27c457e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e", "name": "network-vif-deleted", "tag": "1a9e347e-ccd8-44e3-b595-51e076101a93"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:08.647294 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:33:08.647294 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:33:08.662571 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-5d7aaf9f-c237-404e-9c95-0680398a0bd6 req-6c831c07-c4cf-4743-990c-411c27c457e1 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:08.663544 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-5d7aaf9f-c237-404e-9c95-0680398a0bd6 req-6c831c07-c4cf-4743-990c-411c27c457e1 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:08.689496 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-5d7aaf9f-c237-404e-9c95-0680398a0bd6 req-6c831c07-c4cf-4743-990c-411c27c457e1 service nova] Creating event network-vif-deleted:1a9e347e-ccd8-44e3-b595-51e076101a93 for instance e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e on hv-cinder-81115 Nov 16 00:33:08.700896 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-5d7aaf9f-c237-404e-9c95-0680398a0bd6 req-6c831c07-c4cf-4743-990c-411c27c457e1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066548 Nov 16 00:33:08.702119 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 295/593] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:33:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:33:08.853731 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-e7461be2-5193-4378-a111-73f4a20547b7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:08.854466 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-e7461be2-5193-4378-a111-73f4a20547b7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:08.861701 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e7461be2-5193-4378-a111-73f4a20547b7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:08.862255 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e7461be2-5193-4378-a111-73f4a20547b7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:08.863083 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e7461be2-5193-4378-a111-73f4a20547b7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:08.863563 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e7461be2-5193-4378-a111-73f4a20547b7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:08.933034 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e7461be2-5193-4378-a111-73f4a20547b7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:08.943157 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-e7461be2-5193-4378-a111-73f4a20547b7 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 200 len: 1225 microversion: 2.1 time: 0.092860 Nov 16 00:33:08.943606 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 299/594] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:08 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:09.145309 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-b76f2a25-15f4-45b2-ac08-5f739f0558e1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:09.146322 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-b76f2a25-15f4-45b2-ac08-5f739f0558e1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:09.152926 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b76f2a25-15f4-45b2-ac08-5f739f0558e1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:09.153391 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b76f2a25-15f4-45b2-ac08-5f739f0558e1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:09.154242 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b76f2a25-15f4-45b2-ac08-5f739f0558e1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:09.154670 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b76f2a25-15f4-45b2-ac08-5f739f0558e1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:09.323975 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-b76f2a25-15f4-45b2-ac08-5f739f0558e1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:09.333030 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-b76f2a25-15f4-45b2-ac08-5f739f0558e1 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.192576 Nov 16 00:33:09.333757 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 296/595] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:09 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:09.964481 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f7b6b90a-9ea5-40ba-8190-b00279985eb3 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:09.965338 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f7b6b90a-9ea5-40ba-8190-b00279985eb3 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:09.972791 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f7b6b90a-9ea5-40ba-8190-b00279985eb3 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:09.973233 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f7b6b90a-9ea5-40ba-8190-b00279985eb3 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:09.974057 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f7b6b90a-9ea5-40ba-8190-b00279985eb3 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:09.974501 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f7b6b90a-9ea5-40ba-8190-b00279985eb3 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:09.990443 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-f7b6b90a-9ea5-40ba-8190-b00279985eb3 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] HTTP exception thrown: Instance e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e could not be found. Nov 16 00:33:09.991132 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f7b6b90a-9ea5-40ba-8190-b00279985eb3 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Returning 404 to user: Instance e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e could not be found. {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:33:09.992030 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f7b6b90a-9ea5-40ba-8190-b00279985eb3 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 404 len: 111 microversion: 2.1 time: 0.031660 Nov 16 00:33:09.992623 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 300/596] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:09 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:33:10.163323 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f2a81294-bd39-43e3-b8bd-463c5ad31ba8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1890545805", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2139507500", "security_groups": [{"name": "tempest-secgroup-smoke-1181632784"}], "block_device_mapping_v2": [{"uuid": "99665a2a-90a3-45c8-8018-6e5a66eac9d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5b2f5911-2804-41c1-a851-8f21bec631b6"}]}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:10.300740 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.network.neutron [None req-f2a81294-bd39-43e3-b8bd-463c5ad31ba8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] validate_networks() for [('5b2f5911-2804-41c1-a851-8f21bec631b6', None, None, None, None, None)] {{(pid=122544) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:33:10.353713 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-80382e5b-1e28-454a-9d62-4c93f469fd94 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:10.354414 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-80382e5b-1e28-454a-9d62-4c93f469fd94 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:10.363991 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-80382e5b-1e28-454a-9d62-4c93f469fd94 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:10.364767 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-80382e5b-1e28-454a-9d62-4c93f469fd94 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:10.368848 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-80382e5b-1e28-454a-9d62-4c93f469fd94 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:10.369911 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-80382e5b-1e28-454a-9d62-4c93f469fd94 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:10.530046 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-80382e5b-1e28-454a-9d62-4c93f469fd94 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:10.539373 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-80382e5b-1e28-454a-9d62-4c93f469fd94 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.189442 Nov 16 00:33:10.544105 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 301/597] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:10 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:10.733928 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-f2a81294-bd39-43e3-b8bd-463c5ad31ba8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Flavor limits 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:33:10.734382 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-f2a81294-bd39-43e3-b8bd-463c5ad31ba8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Image limits 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:33:10.735559 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-f2a81294-bd39-43e3-b8bd-463c5ad31ba8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Flavor pref 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:33:10.735983 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-f2a81294-bd39-43e3-b8bd-463c5ad31ba8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Image pref 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:33:10.736459 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-f2a81294-bd39-43e3-b8bd-463c5ad31ba8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:33:10.745529 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f2a81294-bd39-43e3-b8bd-463c5ad31ba8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:10.745969 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f2a81294-bd39-43e3-b8bd-463c5ad31ba8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:10.746825 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f2a81294-bd39-43e3-b8bd-463c5ad31ba8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:10.747272 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f2a81294-bd39-43e3-b8bd-463c5ad31ba8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:10.769069 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-f2a81294-bd39-43e3-b8bd-463c5ad31ba8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Getting quotas for project cce0078a151f47738c5863929c403dc7. Resources: {'instances', 'cores', 'ram'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:33:10.773429 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-f2a81294-bd39-43e3-b8bd-463c5ad31ba8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Getting quotas for user 5fa70de1eca24c8da180736ff9ebc553 and project cce0078a151f47738c5863929c403dc7. Resources: {'instances', 'cores', 'ram'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:33:10.839237 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f2a81294-bd39-43e3-b8bd-463c5ad31ba8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Going to run 1 instances... {{(pid=122544) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:33:10.841411 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f2a81294-bd39-43e3-b8bd-463c5ad31ba8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='99665a2a-90a3-45c8-8018-6e5a66eac9d8',volume_size=None,volume_type=None)] {{(pid=122544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:33:11.012967 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f2a81294-bd39-43e3-b8bd-463c5ad31ba8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [aa098cee-85c3-4386-97f6-5974826c5dec] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 16 00:33:11.557311 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-0433ae43-8221-4bb2-9800-de8542a0c9f3 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:11.557966 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-0433ae43-8221-4bb2-9800-de8542a0c9f3 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:11.564689 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0433ae43-8221-4bb2-9800-de8542a0c9f3 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:11.565129 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0433ae43-8221-4bb2-9800-de8542a0c9f3 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:11.565919 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0433ae43-8221-4bb2-9800-de8542a0c9f3 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:11.566357 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0433ae43-8221-4bb2-9800-de8542a0c9f3 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:11.725364 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-0433ae43-8221-4bb2-9800-de8542a0c9f3 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:11.734075 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-0433ae43-8221-4bb2-9800-de8542a0c9f3 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.180434 Nov 16 00:33:11.735837 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 302/598] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:11 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:12.031751 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO oslo.messaging._drivers.impl_rabbit [None req-f2a81294-bd39-43e3-b8bd-463c5ad31ba8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [aa098cee-85c3-4386-97f6-5974826c5dec] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 43112. Nov 16 00:33:12.038193 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-f2a81294-bd39-43e3-b8bd-463c5ad31ba8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.882874 Nov 16 00:33:12.042199 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 297/599] 10.222.0.31 () {60 vars in 1146 bytes} [Tue Nov 16 00:33:10 2021] POST /compute/v2.1/servers => generated 406 bytes in 1885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 00:33:12.060840 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-be3c3d54-8daa-4c54-858b-a17ed51388d1 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:12.064412 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-be3c3d54-8daa-4c54-858b-a17ed51388d1 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:12.131436 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-be3c3d54-8daa-4c54-858b-a17ed51388d1 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:12.141632 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-be3c3d54-8daa-4c54-858b-a17ed51388d1 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1095 microversion: 2.1 time: 0.089731 Nov 16 00:33:12.142424 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 303/600] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:12 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1095 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:12.753684 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-261f83d2-6ebf-4fba-b5f3-5ac43feea7f3 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:12.754358 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-261f83d2-6ebf-4fba-b5f3-5ac43feea7f3 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:12.762057 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-261f83d2-6ebf-4fba-b5f3-5ac43feea7f3 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:12.762934 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-261f83d2-6ebf-4fba-b5f3-5ac43feea7f3 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:12.763996 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-261f83d2-6ebf-4fba-b5f3-5ac43feea7f3 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:12.764428 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-261f83d2-6ebf-4fba-b5f3-5ac43feea7f3 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:12.902281 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-261f83d2-6ebf-4fba-b5f3-5ac43feea7f3 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:12.912713 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-261f83d2-6ebf-4fba-b5f3-5ac43feea7f3 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.163913 Nov 16 00:33:12.913362 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 298/601] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:12 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:13.159759 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ee0c08d1-3732-4555-8a01-fb4102deffd9 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:13.160301 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ee0c08d1-3732-4555-8a01-fb4102deffd9 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:13.173403 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ee0c08d1-3732-4555-8a01-fb4102deffd9 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:13.173827 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ee0c08d1-3732-4555-8a01-fb4102deffd9 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:13.175323 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ee0c08d1-3732-4555-8a01-fb4102deffd9 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:13.176208 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ee0c08d1-3732-4555-8a01-fb4102deffd9 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:13.304158 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-ee0c08d1-3732-4555-8a01-fb4102deffd9 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:13.313919 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ee0c08d1-3732-4555-8a01-fb4102deffd9 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1201 microversion: 2.1 time: 0.158586 Nov 16 00:33:13.314745 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 304/602] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:13 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1201 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:13.932410 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e6e2f97e-ab0a-4e1c-b86c-dcc9f51c116a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:13.933026 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e6e2f97e-ab0a-4e1c-b86c-dcc9f51c116a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:13.941061 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e6e2f97e-ab0a-4e1c-b86c-dcc9f51c116a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:13.941506 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e6e2f97e-ab0a-4e1c-b86c-dcc9f51c116a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:13.942295 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e6e2f97e-ab0a-4e1c-b86c-dcc9f51c116a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:13.942728 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e6e2f97e-ab0a-4e1c-b86c-dcc9f51c116a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:14.101258 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e6e2f97e-ab0a-4e1c-b86c-dcc9f51c116a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:14.110649 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e6e2f97e-ab0a-4e1c-b86c-dcc9f51c116a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.182126 Nov 16 00:33:14.111396 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 299/603] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:13 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:14.332931 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-23fe055d-7977-4ce7-b3e2-a6548f2f9011 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:14.333519 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-23fe055d-7977-4ce7-b3e2-a6548f2f9011 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:14.339585 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-23fe055d-7977-4ce7-b3e2-a6548f2f9011 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:14.340022 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-23fe055d-7977-4ce7-b3e2-a6548f2f9011 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:14.340817 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-23fe055d-7977-4ce7-b3e2-a6548f2f9011 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:14.341243 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-23fe055d-7977-4ce7-b3e2-a6548f2f9011 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:14.477536 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-23fe055d-7977-4ce7-b3e2-a6548f2f9011 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:14.485900 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-23fe055d-7977-4ce7-b3e2-a6548f2f9011 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1279 microversion: 2.1 time: 0.156519 Nov 16 00:33:14.486482 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 305/604] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:14 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:15.141898 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-064fce7b-b628-444a-81e4-443bf09732a4 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:15.143373 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-064fce7b-b628-444a-81e4-443bf09732a4 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:15.153804 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-064fce7b-b628-444a-81e4-443bf09732a4 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:15.154573 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-064fce7b-b628-444a-81e4-443bf09732a4 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:15.155914 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-064fce7b-b628-444a-81e4-443bf09732a4 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:15.157352 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-064fce7b-b628-444a-81e4-443bf09732a4 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:15.329166 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-064fce7b-b628-444a-81e4-443bf09732a4 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:15.337464 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-064fce7b-b628-444a-81e4-443bf09732a4 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.203829 Nov 16 00:33:15.338070 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 300/605] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:15 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:15.504367 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-58700972-c6cb-45e6-89c7-e9d7f7a8e375 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:15.504969 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-58700972-c6cb-45e6-89c7-e9d7f7a8e375 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:15.510803 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-58700972-c6cb-45e6-89c7-e9d7f7a8e375 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:15.511278 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-58700972-c6cb-45e6-89c7-e9d7f7a8e375 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:15.512046 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-58700972-c6cb-45e6-89c7-e9d7f7a8e375 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:15.512472 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-58700972-c6cb-45e6-89c7-e9d7f7a8e375 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:15.642402 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-58700972-c6cb-45e6-89c7-e9d7f7a8e375 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:15.650590 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-58700972-c6cb-45e6-89c7-e9d7f7a8e375 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1279 microversion: 2.1 time: 0.150630 Nov 16 00:33:15.651197 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 306/606] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:15 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1279 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:16.355609 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-08ae938d-c134-4319-aa76-4c051a9aad4e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:16.356431 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-08ae938d-c134-4319-aa76-4c051a9aad4e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:16.363154 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-08ae938d-c134-4319-aa76-4c051a9aad4e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:16.363606 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-08ae938d-c134-4319-aa76-4c051a9aad4e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:16.364462 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-08ae938d-c134-4319-aa76-4c051a9aad4e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:16.364964 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-08ae938d-c134-4319-aa76-4c051a9aad4e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:16.502040 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-08ae938d-c134-4319-aa76-4c051a9aad4e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:16.510811 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-08ae938d-c134-4319-aa76-4c051a9aad4e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.158717 Nov 16 00:33:16.511447 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 301/607] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:16 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:16.668435 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c9d5c0a4-25c1-4062-b30d-da9b977a20a1 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:16.668977 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c9d5c0a4-25c1-4062-b30d-da9b977a20a1 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:16.675639 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c9d5c0a4-25c1-4062-b30d-da9b977a20a1 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:16.676085 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c9d5c0a4-25c1-4062-b30d-da9b977a20a1 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:16.676862 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c9d5c0a4-25c1-4062-b30d-da9b977a20a1 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:16.677286 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c9d5c0a4-25c1-4062-b30d-da9b977a20a1 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:16.805812 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c9d5c0a4-25c1-4062-b30d-da9b977a20a1 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:16.814920 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c9d5c0a4-25c1-4062-b30d-da9b977a20a1 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1279 microversion: 2.1 time: 0.150219 Nov 16 00:33:16.815523 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 307/608] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:16 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1279 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:17.534023 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-496bd8eb-f517-405a-b8ee-0c19a94b559f tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:17.534772 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-496bd8eb-f517-405a-b8ee-0c19a94b559f tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:17.541972 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-496bd8eb-f517-405a-b8ee-0c19a94b559f tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:17.542414 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-496bd8eb-f517-405a-b8ee-0c19a94b559f tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:17.543233 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-496bd8eb-f517-405a-b8ee-0c19a94b559f tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:17.543656 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-496bd8eb-f517-405a-b8ee-0c19a94b559f tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:17.588873 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-dad9ab6a-7edb-4f25-8747-bcf73721162e req-04a0d384-6561-4453-8f3b-439e80698a2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba21a21-76fa-4a68-b4ec-79454bdc3b4e", "tag": "cbec7d92-b961-49b3-8246-e6dad3a5521d"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:17.590595 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:33:17.590595 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:33:17.601049 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-dad9ab6a-7edb-4f25-8747-bcf73721162e req-04a0d384-6561-4453-8f3b-439e80698a2d service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:17.601488 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-dad9ab6a-7edb-4f25-8747-bcf73721162e req-04a0d384-6561-4453-8f3b-439e80698a2d service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:17.636604 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-dad9ab6a-7edb-4f25-8747-bcf73721162e req-04a0d384-6561-4453-8f3b-439e80698a2d service nova] Creating event network-changed:cbec7d92-b961-49b3-8246-e6dad3a5521d for instance 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e on hv-cinder-81115 Nov 16 00:33:17.645146 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-dad9ab6a-7edb-4f25-8747-bcf73721162e req-04a0d384-6561-4453-8f3b-439e80698a2d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059234 Nov 16 00:33:17.645995 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 308/609] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:33:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:33:17.730809 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-496bd8eb-f517-405a-b8ee-0c19a94b559f tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:17.746761 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-496bd8eb-f517-405a-b8ee-0c19a94b559f tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.217288 Nov 16 00:33:17.749073 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 302/610] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:17 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:17.835855 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-b6d76fc5-2872-4715-9ed5-7eb3f8681cd8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:17.836601 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b6d76fc5-2872-4715-9ed5-7eb3f8681cd8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:17.844136 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b6d76fc5-2872-4715-9ed5-7eb3f8681cd8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:17.844865 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b6d76fc5-2872-4715-9ed5-7eb3f8681cd8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:17.845713 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b6d76fc5-2872-4715-9ed5-7eb3f8681cd8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:17.846160 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b6d76fc5-2872-4715-9ed5-7eb3f8681cd8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:18.069189 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-b6d76fc5-2872-4715-9ed5-7eb3f8681cd8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:18.069915 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-b6d76fc5-2872-4715-9ed5-7eb3f8681cd8 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1279 microversion: 2.1 time: 0.239194 Nov 16 00:33:18.070210 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 309/611] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:17 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1279 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:18.769078 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-49a77b26-afb3-493f-8184-a48be91de1fa tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:18.769768 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-49a77b26-afb3-493f-8184-a48be91de1fa tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:18.775580 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-49a77b26-afb3-493f-8184-a48be91de1fa tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:18.776013 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-49a77b26-afb3-493f-8184-a48be91de1fa tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:18.776779 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-49a77b26-afb3-493f-8184-a48be91de1fa tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:18.777201 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-49a77b26-afb3-493f-8184-a48be91de1fa tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:18.915556 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-49a77b26-afb3-493f-8184-a48be91de1fa tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:18.923738 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-49a77b26-afb3-493f-8184-a48be91de1fa tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.158824 Nov 16 00:33:18.924317 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 303/612] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:18 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:19.086482 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1e04aa07-5539-4fa6-8906-938d1b21eb57 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:19.087104 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1e04aa07-5539-4fa6-8906-938d1b21eb57 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:19.094801 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1e04aa07-5539-4fa6-8906-938d1b21eb57 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:19.095451 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1e04aa07-5539-4fa6-8906-938d1b21eb57 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:19.096833 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1e04aa07-5539-4fa6-8906-938d1b21eb57 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:19.097274 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1e04aa07-5539-4fa6-8906-938d1b21eb57 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:19.226768 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-1e04aa07-5539-4fa6-8906-938d1b21eb57 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:19.233921 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-1e04aa07-5539-4fa6-8906-938d1b21eb57 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1267 microversion: 2.1 time: 0.151088 Nov 16 00:33:19.235039 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 310/613] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:19 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:19.941091 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-6336e876-c647-46e9-8d25-fb642c04a103 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:19.941685 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-6336e876-c647-46e9-8d25-fb642c04a103 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:19.948302 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6336e876-c647-46e9-8d25-fb642c04a103 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:19.948914 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6336e876-c647-46e9-8d25-fb642c04a103 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:19.949751 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6336e876-c647-46e9-8d25-fb642c04a103 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:19.950232 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6336e876-c647-46e9-8d25-fb642c04a103 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:20.084124 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-6336e876-c647-46e9-8d25-fb642c04a103 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:20.094395 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-6336e876-c647-46e9-8d25-fb642c04a103 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.156351 Nov 16 00:33:20.094993 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 304/614] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:19 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:20.251742 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-0bd4648c-23a8-48c5-8316-6e2a2226b53d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:20.252355 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-0bd4648c-23a8-48c5-8316-6e2a2226b53d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:20.258207 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0bd4648c-23a8-48c5-8316-6e2a2226b53d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:20.258654 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0bd4648c-23a8-48c5-8316-6e2a2226b53d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:20.259552 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0bd4648c-23a8-48c5-8316-6e2a2226b53d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:20.259985 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0bd4648c-23a8-48c5-8316-6e2a2226b53d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:20.384362 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-0bd4648c-23a8-48c5-8316-6e2a2226b53d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:20.392201 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-0bd4648c-23a8-48c5-8316-6e2a2226b53d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1267 microversion: 2.1 time: 0.144354 Nov 16 00:33:20.392756 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 311/615] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:20 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:21.112177 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3518e777-059a-48ac-b2f6-39e57d957f67 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:21.112780 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3518e777-059a-48ac-b2f6-39e57d957f67 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:21.115454 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d1f03905-0a30-45a3-9a7b-4f08c9d17821] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 16 00:33:21.119794 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3518e777-059a-48ac-b2f6-39e57d957f67 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:21.120235 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3518e777-059a-48ac-b2f6-39e57d957f67 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:21.121022 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3518e777-059a-48ac-b2f6-39e57d957f67 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:21.121518 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3518e777-059a-48ac-b2f6-39e57d957f67 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:21.260450 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3518e777-059a-48ac-b2f6-39e57d957f67 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:21.268538 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-3518e777-059a-48ac-b2f6-39e57d957f67 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.160991 Nov 16 00:33:21.269108 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 305/616] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:21 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:21.410203 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ff83f88b-c90d-4d04-9ca5-72cb44c89cbd tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:21.410866 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ff83f88b-c90d-4d04-9ca5-72cb44c89cbd tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:21.417322 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ff83f88b-c90d-4d04-9ca5-72cb44c89cbd tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:21.417761 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ff83f88b-c90d-4d04-9ca5-72cb44c89cbd tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:21.418595 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ff83f88b-c90d-4d04-9ca5-72cb44c89cbd tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:21.419028 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ff83f88b-c90d-4d04-9ca5-72cb44c89cbd tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:21.553356 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-ff83f88b-c90d-4d04-9ca5-72cb44c89cbd tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:21.560744 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ff83f88b-c90d-4d04-9ca5-72cb44c89cbd tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1267 microversion: 2.1 time: 0.155451 Nov 16 00:33:21.561303 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 312/617] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:21 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:22.154363 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-1433e001-a172-40ee-9842-38abbb675af5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:22.155281 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-1433e001-a172-40ee-9842-38abbb675af5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:22.176809 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1433e001-a172-40ee-9842-38abbb675af5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:22.177254 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1433e001-a172-40ee-9842-38abbb675af5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:22.178033 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1433e001-a172-40ee-9842-38abbb675af5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:22.178464 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1433e001-a172-40ee-9842-38abbb675af5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:22.195889 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO oslo.messaging._drivers.impl_rabbit [-] [d1f03905-0a30-45a3-9a7b-4f08c9d17821] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 43226. Nov 16 00:33:22.221461 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-1433e001-a172-40ee-9842-38abbb675af5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/os-volume_attachments/5dfe14b9-8ca2-49c8-8bc8-d03cd63e6439" status: 200 len: 194 microversion: 2.20 time: 0.069636 Nov 16 00:33:22.228211 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 306/618] 10.222.0.31 () {60 vars in 1453 bytes} [Tue Nov 16 00:33:22 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/os-volume_attachments/5dfe14b9-8ca2-49c8-8bc8-d03cd63e6439 => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:33:22.256945 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c48f8c5f-b82f-459e-a8ea-5cccb058a691 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:22.257847 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c48f8c5f-b82f-459e-a8ea-5cccb058a691 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:22.263734 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c48f8c5f-b82f-459e-a8ea-5cccb058a691 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:22.264172 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c48f8c5f-b82f-459e-a8ea-5cccb058a691 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:22.264938 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c48f8c5f-b82f-459e-a8ea-5cccb058a691 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:22.265880 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c48f8c5f-b82f-459e-a8ea-5cccb058a691 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:22.287102 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-89fa5514-3f18-47b9-a33f-89b2398556ee tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:22.287978 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-89fa5514-3f18-47b9-a33f-89b2398556ee tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:22.294408 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-89fa5514-3f18-47b9-a33f-89b2398556ee tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:22.294727 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-89fa5514-3f18-47b9-a33f-89b2398556ee tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:22.295537 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-89fa5514-3f18-47b9-a33f-89b2398556ee tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:22.295955 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-89fa5514-3f18-47b9-a33f-89b2398556ee tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:22.302772 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c48f8c5f-b82f-459e-a8ea-5cccb058a691 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049543 Nov 16 00:33:22.303386 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 313/619] 10.222.0.31 () {58 vars in 1301 bytes} [Tue Nov 16 00:33:22 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:33:22.307842 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-93102a50-18e7-4a0f-959a-c8a325fe07cb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:22.308329 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-93102a50-18e7-4a0f-959a-c8a325fe07cb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:22.320306 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-93102a50-18e7-4a0f-959a-c8a325fe07cb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:22.320740 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-93102a50-18e7-4a0f-959a-c8a325fe07cb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:22.321536 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-93102a50-18e7-4a0f-959a-c8a325fe07cb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:22.321953 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-93102a50-18e7-4a0f-959a-c8a325fe07cb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:22.413744 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.objects.instance [None req-93102a50-18e7-4a0f-959a-c8a325fe07cb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lazy-loading 'services' on Instance uuid 3f9b823f-75c2-4baf-9577-5dc85ec77405 {{(pid=122543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:33:22.478386 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-89fa5514-3f18-47b9-a33f-89b2398556ee tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:22.483419 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-93102a50-18e7-4a0f-959a-c8a325fe07cb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "DELETE /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/os-volume_attachments/5dfe14b9-8ca2-49c8-8bc8-d03cd63e6439" status: 202 len: 0 microversion: 2.20 time: 0.178626 Nov 16 00:33:22.484549 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 314/620] 10.222.0.31 () {60 vars in 1456 bytes} [Tue Nov 16 00:33:22 2021] DELETE /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/os-volume_attachments/5dfe14b9-8ca2-49c8-8bc8-d03cd63e6439 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 16 00:33:22.488709 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-89fa5514-3f18-47b9-a33f-89b2398556ee tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.206135 Nov 16 00:33:22.499331 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 307/621] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:22 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:22.499458 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-cd686f0a-762e-4714-b490-2c75f378b8e0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:22.499458 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-cd686f0a-762e-4714-b490-2c75f378b8e0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:22.500464 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-c30945d5-44a3-48d2-b88e-5d6eab3e2156 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:22.500464 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-c30945d5-44a3-48d2-b88e-5d6eab3e2156 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:22.500689 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cd686f0a-762e-4714-b490-2c75f378b8e0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:22.500689 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cd686f0a-762e-4714-b490-2c75f378b8e0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:22.500689 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cd686f0a-762e-4714-b490-2c75f378b8e0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:22.500689 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cd686f0a-762e-4714-b490-2c75f378b8e0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:22.501388 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c30945d5-44a3-48d2-b88e-5d6eab3e2156 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:22.502349 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c30945d5-44a3-48d2-b88e-5d6eab3e2156 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:22.503165 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c30945d5-44a3-48d2-b88e-5d6eab3e2156 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:22.503818 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c30945d5-44a3-48d2-b88e-5d6eab3e2156 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:22.525693 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-cd686f0a-762e-4714-b490-2c75f378b8e0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Going to try to terminate instance {{(pid=122543) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:33:22.535575 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-c30945d5-44a3-48d2-b88e-5d6eab3e2156 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045466 Nov 16 00:33:22.536142 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 308/622] 10.222.0.31 () {60 vars in 1342 bytes} [Tue Nov 16 00:33:22 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:33:22.579508 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-c05e5020-bfb7-44a3-af3a-23b9c9b37829 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:22.580405 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-c05e5020-bfb7-44a3-af3a-23b9c9b37829 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:22.586952 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c05e5020-bfb7-44a3-af3a-23b9c9b37829 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:22.587434 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c05e5020-bfb7-44a3-af3a-23b9c9b37829 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:22.588228 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c05e5020-bfb7-44a3-af3a-23b9c9b37829 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:22.588651 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c05e5020-bfb7-44a3-af3a-23b9c9b37829 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:22.604964 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-cd686f0a-762e-4714-b490-2c75f378b8e0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 204 len: 0 microversion: 2.1 time: 0.118735 Nov 16 00:33:22.606126 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 315/623] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:33:22 2021] DELETE /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 00:33:22.615163 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-82c5d231-81b5-40d2-8ac4-7f9e24b8c768 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:22.616084 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-82c5d231-81b5-40d2-8ac4-7f9e24b8c768 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:22.622393 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-82c5d231-81b5-40d2-8ac4-7f9e24b8c768 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:22.623238 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-82c5d231-81b5-40d2-8ac4-7f9e24b8c768 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:22.624021 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-82c5d231-81b5-40d2-8ac4-7f9e24b8c768 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:22.624454 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-82c5d231-81b5-40d2-8ac4-7f9e24b8c768 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:22.716656 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-c05e5020-bfb7-44a3-af3a-23b9c9b37829 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:22.726056 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-c05e5020-bfb7-44a3-af3a-23b9c9b37829 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1267 microversion: 2.1 time: 0.152034 Nov 16 00:33:22.726653 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 309/624] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:22 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:22.757564 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-82c5d231-81b5-40d2-8ac4-7f9e24b8c768 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:22.765502 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-82c5d231-81b5-40d2-8ac4-7f9e24b8c768 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1673 microversion: 2.1 time: 0.154949 Nov 16 00:33:22.766089 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 316/625] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:22 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:23.509290 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-654ed4c1-da5b-474a-ba8a-d47e6b639d34 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:23.509906 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-654ed4c1-da5b-474a-ba8a-d47e6b639d34 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:23.516399 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-654ed4c1-da5b-474a-ba8a-d47e6b639d34 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:23.517082 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-654ed4c1-da5b-474a-ba8a-d47e6b639d34 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:23.518189 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-654ed4c1-da5b-474a-ba8a-d47e6b639d34 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:23.518665 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-654ed4c1-da5b-474a-ba8a-d47e6b639d34 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:23.547502 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-4f9e9fc8-8ec5-459d-9d4f-1dfb0d7c4245 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:23.548469 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-4f9e9fc8-8ec5-459d-9d4f-1dfb0d7c4245 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:23.554680 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4f9e9fc8-8ec5-459d-9d4f-1dfb0d7c4245 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:23.555153 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4f9e9fc8-8ec5-459d-9d4f-1dfb0d7c4245 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:23.555931 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4f9e9fc8-8ec5-459d-9d4f-1dfb0d7c4245 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:23.556357 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4f9e9fc8-8ec5-459d-9d4f-1dfb0d7c4245 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:23.588862 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-4f9e9fc8-8ec5-459d-9d4f-1dfb0d7c4245 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045046 Nov 16 00:33:23.589762 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 317/626] 10.222.0.31 () {60 vars in 1342 bytes} [Tue Nov 16 00:33:23 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:23.658621 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-654ed4c1-da5b-474a-ba8a-d47e6b639d34 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:23.660437 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-b678a85e-ee02-4dbe-8c8f-2b069e189fb9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:23.660910 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b678a85e-ee02-4dbe-8c8f-2b069e189fb9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:23.671913 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b678a85e-ee02-4dbe-8c8f-2b069e189fb9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:23.672717 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b678a85e-ee02-4dbe-8c8f-2b069e189fb9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:23.673614 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b678a85e-ee02-4dbe-8c8f-2b069e189fb9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:23.674050 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-654ed4c1-da5b-474a-ba8a-d47e6b639d34 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.168042 Nov 16 00:33:23.674219 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b678a85e-ee02-4dbe-8c8f-2b069e189fb9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:23.674999 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 310/627] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:23 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:23.700602 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b678a85e-ee02-4dbe-8c8f-2b069e189fb9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Going to try to terminate instance {{(pid=122543) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:33:23.743801 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e2bded9a-99f2-4f2f-895c-0234be87b85c tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:23.744492 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e2bded9a-99f2-4f2f-895c-0234be87b85c tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:23.752854 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e2bded9a-99f2-4f2f-895c-0234be87b85c tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:23.753542 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e2bded9a-99f2-4f2f-895c-0234be87b85c tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:23.754321 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e2bded9a-99f2-4f2f-895c-0234be87b85c tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:23.754926 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e2bded9a-99f2-4f2f-895c-0234be87b85c tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:23.791465 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-b678a85e-ee02-4dbe-8c8f-2b069e189fb9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "DELETE /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 204 len: 0 microversion: 2.20 time: 0.134232 Nov 16 00:33:23.791691 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 318/628] 10.222.0.31 () {60 vars in 1279 bytes} [Tue Nov 16 00:33:23 2021] DELETE /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 16 00:33:23.797305 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-bbe708e5-f64c-4da1-b22a-d317bfd00d89 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:23.798174 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-bbe708e5-f64c-4da1-b22a-d317bfd00d89 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:23.804714 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bbe708e5-f64c-4da1-b22a-d317bfd00d89 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:23.805268 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bbe708e5-f64c-4da1-b22a-d317bfd00d89 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:23.806097 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bbe708e5-f64c-4da1-b22a-d317bfd00d89 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:23.806665 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bbe708e5-f64c-4da1-b22a-d317bfd00d89 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:23.949859 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-bbe708e5-f64c-4da1-b22a-d317bfd00d89 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:23.958763 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-bbe708e5-f64c-4da1-b22a-d317bfd00d89 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1673 microversion: 2.1 time: 0.165771 Nov 16 00:33:23.959426 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 319/629] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:23 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:23.964136 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f88bbb35-8e9b-4b15-ac5d-b166d589a645 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:23.965032 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f88bbb35-8e9b-4b15-ac5d-b166d589a645 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:23.971990 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f88bbb35-8e9b-4b15-ac5d-b166d589a645 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:23.972512 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f88bbb35-8e9b-4b15-ac5d-b166d589a645 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:23.973409 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f88bbb35-8e9b-4b15-ac5d-b166d589a645 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:23.973910 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f88bbb35-8e9b-4b15-ac5d-b166d589a645 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:24.116527 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f88bbb35-8e9b-4b15-ac5d-b166d589a645 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:24.124783 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f88bbb35-8e9b-4b15-ac5d-b166d589a645 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:24.126484 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f88bbb35-8e9b-4b15-ac5d-b166d589a645 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:24.127695 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f88bbb35-8e9b-4b15-ac5d-b166d589a645 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1721 microversion: 2.20 time: 0.167265 Nov 16 00:33:24.128243 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 320/630] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:33:23 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:33:24.140577 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e2bded9a-99f2-4f2f-895c-0234be87b85c tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:24.148214 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e2bded9a-99f2-4f2f-895c-0234be87b85c tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1267 microversion: 2.1 time: 0.408680 Nov 16 00:33:24.148782 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 311/631] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:23 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1267 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:24.692165 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-acb0beff-f21d-487f-8e72-d5e8476ac890 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:24.692758 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-acb0beff-f21d-487f-8e72-d5e8476ac890 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:24.698618 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-acb0beff-f21d-487f-8e72-d5e8476ac890 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:24.699079 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-acb0beff-f21d-487f-8e72-d5e8476ac890 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:24.699886 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-acb0beff-f21d-487f-8e72-d5e8476ac890 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:24.700317 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-acb0beff-f21d-487f-8e72-d5e8476ac890 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:24.827311 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-acb0beff-f21d-487f-8e72-d5e8476ac890 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:24.835752 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-acb0beff-f21d-487f-8e72-d5e8476ac890 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.147521 Nov 16 00:33:24.836338 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 321/632] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:24 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:24.983744 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0c38a9ce-815d-4c3c-8e35-72ac80f968fa tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:24.984350 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0c38a9ce-815d-4c3c-8e35-72ac80f968fa tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:24.990502 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0c38a9ce-815d-4c3c-8e35-72ac80f968fa tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:24.990941 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0c38a9ce-815d-4c3c-8e35-72ac80f968fa tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:24.991752 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0c38a9ce-815d-4c3c-8e35-72ac80f968fa tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:24.992183 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0c38a9ce-815d-4c3c-8e35-72ac80f968fa tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:25.111950 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0c38a9ce-815d-4c3c-8e35-72ac80f968fa tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:25.119067 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0c38a9ce-815d-4c3c-8e35-72ac80f968fa tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1673 microversion: 2.1 time: 0.139127 Nov 16 00:33:25.119627 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 312/633] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:24 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1673 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:25.146698 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-931cb215-bca2-44ee-98f1-6d0ce0743c97 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:25.147326 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-931cb215-bca2-44ee-98f1-6d0ce0743c97 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:25.152972 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-931cb215-bca2-44ee-98f1-6d0ce0743c97 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:25.153412 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-931cb215-bca2-44ee-98f1-6d0ce0743c97 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:25.154166 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-931cb215-bca2-44ee-98f1-6d0ce0743c97 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:25.154590 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-931cb215-bca2-44ee-98f1-6d0ce0743c97 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:25.165485 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-9c161419-85c3-40fa-9cfb-6e70753eda78 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:25.166083 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-9c161419-85c3-40fa-9cfb-6e70753eda78 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:25.171868 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9c161419-85c3-40fa-9cfb-6e70753eda78 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:25.172307 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9c161419-85c3-40fa-9cfb-6e70753eda78 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:25.173130 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9c161419-85c3-40fa-9cfb-6e70753eda78 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:25.173668 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9c161419-85c3-40fa-9cfb-6e70753eda78 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:25.278222 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-931cb215-bca2-44ee-98f1-6d0ce0743c97 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:25.286881 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-931cb215-bca2-44ee-98f1-6d0ce0743c97 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:25.288638 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-931cb215-bca2-44ee-98f1-6d0ce0743c97 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:25.289922 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-931cb215-bca2-44ee-98f1-6d0ce0743c97 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1721 microversion: 2.20 time: 0.146907 Nov 16 00:33:25.290746 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 322/634] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:33:25 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:33:25.295972 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-9c161419-85c3-40fa-9cfb-6e70753eda78 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:25.304585 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-9c161419-85c3-40fa-9cfb-6e70753eda78 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1267 microversion: 2.1 time: 0.142960 Nov 16 00:33:25.305148 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 313/635] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:25 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1267 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:25.853267 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8ffc4a71-57bb-46c8-862b-f9cf8c567850 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:25.853866 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8ffc4a71-57bb-46c8-862b-f9cf8c567850 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:25.859837 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8ffc4a71-57bb-46c8-862b-f9cf8c567850 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:25.860545 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8ffc4a71-57bb-46c8-862b-f9cf8c567850 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:25.861562 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8ffc4a71-57bb-46c8-862b-f9cf8c567850 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:25.861996 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8ffc4a71-57bb-46c8-862b-f9cf8c567850 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:25.986843 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-8ffc4a71-57bb-46c8-862b-f9cf8c567850 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:25.998903 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8ffc4a71-57bb-46c8-862b-f9cf8c567850 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.149230 Nov 16 00:33:25.999513 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 323/636] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:25 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:26.136705 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e52bcf00-51e4-40e9-9111-1a9dee854728 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:26.137382 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e52bcf00-51e4-40e9-9111-1a9dee854728 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:26.143592 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e52bcf00-51e4-40e9-9111-1a9dee854728 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:26.144037 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e52bcf00-51e4-40e9-9111-1a9dee854728 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:26.144797 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e52bcf00-51e4-40e9-9111-1a9dee854728 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:26.145231 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e52bcf00-51e4-40e9-9111-1a9dee854728 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:26.268754 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e52bcf00-51e4-40e9-9111-1a9dee854728 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:26.276012 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e52bcf00-51e4-40e9-9111-1a9dee854728 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1673 microversion: 2.1 time: 0.143041 Nov 16 00:33:26.276575 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 314/637] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:26 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1673 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:26.308573 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-e6b65dd5-1ea5-4f7c-b8e0-574799ce3a17 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:26.309172 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-e6b65dd5-1ea5-4f7c-b8e0-574799ce3a17 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:26.316661 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e6b65dd5-1ea5-4f7c-b8e0-574799ce3a17 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:26.316889 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e6b65dd5-1ea5-4f7c-b8e0-574799ce3a17 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:26.317953 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e6b65dd5-1ea5-4f7c-b8e0-574799ce3a17 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:26.318082 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e6b65dd5-1ea5-4f7c-b8e0-574799ce3a17 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:26.321309 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-db33f856-d670-4df4-9973-4c191ac07409 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:26.321895 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-db33f856-d670-4df4-9973-4c191ac07409 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:26.328432 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-db33f856-d670-4df4-9973-4c191ac07409 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:26.328913 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-db33f856-d670-4df4-9973-4c191ac07409 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:26.329679 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-db33f856-d670-4df4-9973-4c191ac07409 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:26.330110 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-db33f856-d670-4df4-9973-4c191ac07409 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:26.446287 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e6b65dd5-1ea5-4f7c-b8e0-574799ce3a17 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:26.453290 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-db33f856-d670-4df4-9973-4c191ac07409 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:26.454979 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e6b65dd5-1ea5-4f7c-b8e0-574799ce3a17 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:26.456519 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e6b65dd5-1ea5-4f7c-b8e0-574799ce3a17 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:26.458180 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-e6b65dd5-1ea5-4f7c-b8e0-574799ce3a17 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1721 microversion: 2.20 time: 0.153261 Nov 16 00:33:26.458994 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 324/638] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:33:26 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:33:26.463556 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-db33f856-d670-4df4-9973-4c191ac07409 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1267 microversion: 2.1 time: 0.145707 Nov 16 00:33:26.464211 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 315/639] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:26 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:27.018121 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-97901b73-1aaa-401b-9449-c8c5b53d7823 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:27.018646 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-97901b73-1aaa-401b-9449-c8c5b53d7823 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:27.024541 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-97901b73-1aaa-401b-9449-c8c5b53d7823 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:27.024985 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-97901b73-1aaa-401b-9449-c8c5b53d7823 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:27.025748 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-97901b73-1aaa-401b-9449-c8c5b53d7823 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:27.026183 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-97901b73-1aaa-401b-9449-c8c5b53d7823 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:27.149712 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-97901b73-1aaa-401b-9449-c8c5b53d7823 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:27.158086 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-97901b73-1aaa-401b-9449-c8c5b53d7823 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.144120 Nov 16 00:33:27.158643 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 325/640] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:27 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:27.295268 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-6d9799a2-06ca-4af9-9b3f-dcb351366a48 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:27.296113 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-6d9799a2-06ca-4af9-9b3f-dcb351366a48 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:27.302719 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6d9799a2-06ca-4af9-9b3f-dcb351366a48 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:27.303280 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6d9799a2-06ca-4af9-9b3f-dcb351366a48 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:27.304110 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6d9799a2-06ca-4af9-9b3f-dcb351366a48 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:27.304537 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6d9799a2-06ca-4af9-9b3f-dcb351366a48 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:27.435429 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-6d9799a2-06ca-4af9-9b3f-dcb351366a48 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:27.442898 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-6d9799a2-06ca-4af9-9b3f-dcb351366a48 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1673 microversion: 2.1 time: 0.151489 Nov 16 00:33:27.443603 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 316/641] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:27 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:27.480422 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-638af566-d316-4baa-8bfe-dc872398d294 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:27.480793 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-4df0612b-eefa-49a1-9021-7628cb872ae4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:27.480985 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-638af566-d316-4baa-8bfe-dc872398d294 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:27.481616 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-4df0612b-eefa-49a1-9021-7628cb872ae4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:27.487347 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-638af566-d316-4baa-8bfe-dc872398d294 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:27.487781 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-638af566-d316-4baa-8bfe-dc872398d294 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:27.488713 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-638af566-d316-4baa-8bfe-dc872398d294 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:27.489338 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-638af566-d316-4baa-8bfe-dc872398d294 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:27.490933 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4df0612b-eefa-49a1-9021-7628cb872ae4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:27.491916 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4df0612b-eefa-49a1-9021-7628cb872ae4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:27.493060 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4df0612b-eefa-49a1-9021-7628cb872ae4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:27.493643 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4df0612b-eefa-49a1-9021-7628cb872ae4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:27.647270 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-638af566-d316-4baa-8bfe-dc872398d294 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:27.656572 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-638af566-d316-4baa-8bfe-dc872398d294 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1267 microversion: 2.1 time: 0.179676 Nov 16 00:33:27.657658 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 317/642] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:27 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:27.745497 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-4df0612b-eefa-49a1-9021-7628cb872ae4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:27.760115 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-4df0612b-eefa-49a1-9021-7628cb872ae4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:27.762089 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-4df0612b-eefa-49a1-9021-7628cb872ae4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:27.763645 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-4df0612b-eefa-49a1-9021-7628cb872ae4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1721 microversion: 2.20 time: 0.287209 Nov 16 00:33:27.764246 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 326/643] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:33:27 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1721 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:33:28.176520 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-fcd0a79e-47be-4dd1-a1eb-6c3946180d3c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:28.177191 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-fcd0a79e-47be-4dd1-a1eb-6c3946180d3c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:28.183364 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-fcd0a79e-47be-4dd1-a1eb-6c3946180d3c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:28.184106 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-fcd0a79e-47be-4dd1-a1eb-6c3946180d3c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:28.185069 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-fcd0a79e-47be-4dd1-a1eb-6c3946180d3c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:28.185671 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-fcd0a79e-47be-4dd1-a1eb-6c3946180d3c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:28.319257 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-86e7c3eb-56ff-4d1e-97dd-a382e9624fb2 req-e7da3a42-609d-44d0-8424-81046332849a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f376e4-af26-4799-9127-58d9efd50cdc", "name": "network-vif-deleted", "tag": "01184432-b920-416d-948c-2998a3138394"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:28.320908 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:33:28.320908 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:33:28.334082 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-86e7c3eb-56ff-4d1e-97dd-a382e9624fb2 req-e7da3a42-609d-44d0-8424-81046332849a service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:28.334672 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-86e7c3eb-56ff-4d1e-97dd-a382e9624fb2 req-e7da3a42-609d-44d0-8424-81046332849a service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:28.348053 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-86e7c3eb-56ff-4d1e-97dd-a382e9624fb2 req-e7da3a42-609d-44d0-8424-81046332849a service nova] Creating event network-vif-deleted:01184432-b920-416d-948c-2998a3138394 for instance d6f376e4-af26-4799-9127-58d9efd50cdc on hv-cinder-81115 Nov 16 00:33:28.355647 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-86e7c3eb-56ff-4d1e-97dd-a382e9624fb2 req-e7da3a42-609d-44d0-8424-81046332849a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040110 Nov 16 00:33:28.356272 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 327/644] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:33:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:33:28.462522 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-499be7ef-b825-43a4-aed9-b5603f4a64a5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:28.463275 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-499be7ef-b825-43a4-aed9-b5603f4a64a5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:28.480149 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-499be7ef-b825-43a4-aed9-b5603f4a64a5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:28.481936 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-499be7ef-b825-43a4-aed9-b5603f4a64a5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:28.484065 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-499be7ef-b825-43a4-aed9-b5603f4a64a5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:28.484544 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-499be7ef-b825-43a4-aed9-b5603f4a64a5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:28.545816 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-499be7ef-b825-43a4-aed9-b5603f4a64a5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:28.547633 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-499be7ef-b825-43a4-aed9-b5603f4a64a5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:28.548894 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.objects.instance [None req-499be7ef-b825-43a4-aed9-b5603f4a64a5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lazy-loading 'fault' on Instance uuid d6f376e4-af26-4799-9127-58d9efd50cdc {{(pid=122543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:33:28.600947 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-499be7ef-b825-43a4-aed9-b5603f4a64a5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:28.609769 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-499be7ef-b825-43a4-aed9-b5603f4a64a5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 200 len: 1327 microversion: 2.1 time: 0.151459 Nov 16 00:33:28.620000 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 328/645] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:28 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 1327 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:28.623412 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-fcd0a79e-47be-4dd1-a1eb-6c3946180d3c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:28.634328 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-fcd0a79e-47be-4dd1-a1eb-6c3946180d3c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.462319 Nov 16 00:33:28.637709 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 318/646] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:28 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:28.675958 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-a2bf82b6-6358-44d8-9c67-675b1305fe80 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:28.676461 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-a2bf82b6-6358-44d8-9c67-675b1305fe80 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:28.687420 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a2bf82b6-6358-44d8-9c67-675b1305fe80 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:28.690128 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a2bf82b6-6358-44d8-9c67-675b1305fe80 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:28.691275 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a2bf82b6-6358-44d8-9c67-675b1305fe80 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:28.692737 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a2bf82b6-6358-44d8-9c67-675b1305fe80 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:28.789178 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-151a5091-fc9e-4eec-8cb8-ef70c6e2daea tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:28.791086 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-151a5091-fc9e-4eec-8cb8-ef70c6e2daea tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:28.811292 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-151a5091-fc9e-4eec-8cb8-ef70c6e2daea tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:28.815777 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-151a5091-fc9e-4eec-8cb8-ef70c6e2daea tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:28.818318 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-151a5091-fc9e-4eec-8cb8-ef70c6e2daea tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:28.820599 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-151a5091-fc9e-4eec-8cb8-ef70c6e2daea tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:28.898153 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-a2bf82b6-6358-44d8-9c67-675b1305fe80 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:28.913566 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-a2bf82b6-6358-44d8-9c67-675b1305fe80 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1267 microversion: 2.1 time: 0.239017 Nov 16 00:33:28.914451 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 329/647] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:28 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:29.207376 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-151a5091-fc9e-4eec-8cb8-ef70c6e2daea tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:29.225329 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-151a5091-fc9e-4eec-8cb8-ef70c6e2daea tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:29.227359 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-151a5091-fc9e-4eec-8cb8-ef70c6e2daea tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:29.229543 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-151a5091-fc9e-4eec-8cb8-ef70c6e2daea tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 200 len: 1721 microversion: 2.20 time: 0.449203 Nov 16 00:33:29.231201 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 319/648] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:33:28 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 1721 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:33:29.525760 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-72850f5c-ec97-43d9-b0b3-ddc5531e1aff req-f830e17a-5bfc-40e8-b629-c9213980986f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f9b823f-75c2-4baf-9577-5dc85ec77405", "name": "network-vif-deleted", "tag": "10abc4a6-a723-4a5c-855b-11d4b6d40eb9"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:29.529593 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:33:29.529593 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:33:29.542106 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-72850f5c-ec97-43d9-b0b3-ddc5531e1aff req-f830e17a-5bfc-40e8-b629-c9213980986f service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:29.544685 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-72850f5c-ec97-43d9-b0b3-ddc5531e1aff req-f830e17a-5bfc-40e8-b629-c9213980986f service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:29.590536 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-72850f5c-ec97-43d9-b0b3-ddc5531e1aff req-f830e17a-5bfc-40e8-b629-c9213980986f service nova] Creating event network-vif-deleted:10abc4a6-a723-4a5c-855b-11d4b6d40eb9 for instance 3f9b823f-75c2-4baf-9577-5dc85ec77405 on hv-cinder-81115 Nov 16 00:33:29.601880 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-72850f5c-ec97-43d9-b0b3-ddc5531e1aff req-f830e17a-5bfc-40e8-b629-c9213980986f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087420 Nov 16 00:33:29.603005 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 330/649] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:33:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:33:29.629419 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f72a718e-5503-4ffb-8e04-29494b0ebccb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:29.630801 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f72a718e-5503-4ffb-8e04-29494b0ebccb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:29.640219 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f72a718e-5503-4ffb-8e04-29494b0ebccb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:29.641304 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f72a718e-5503-4ffb-8e04-29494b0ebccb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:29.642273 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f72a718e-5503-4ffb-8e04-29494b0ebccb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:29.642857 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f72a718e-5503-4ffb-8e04-29494b0ebccb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:29.654149 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-3e2f3a77-fbc7-4d04-92d0-238bb7b0d044 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:29.654907 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-3e2f3a77-fbc7-4d04-92d0-238bb7b0d044 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:29.658550 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-f72a718e-5503-4ffb-8e04-29494b0ebccb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] HTTP exception thrown: Instance d6f376e4-af26-4799-9127-58d9efd50cdc could not be found. Nov 16 00:33:29.659556 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f72a718e-5503-4ffb-8e04-29494b0ebccb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Returning 404 to user: Instance d6f376e4-af26-4799-9127-58d9efd50cdc could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:33:29.660378 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-f72a718e-5503-4ffb-8e04-29494b0ebccb tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 404 len: 111 microversion: 2.1 time: 0.036070 Nov 16 00:33:29.661078 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 320/650] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:29 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:33:29.668722 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3e2f3a77-fbc7-4d04-92d0-238bb7b0d044 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:29.669234 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3e2f3a77-fbc7-4d04-92d0-238bb7b0d044 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:29.669911 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-2eb24130-16a9-4842-a9bb-18899f380171 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '.version_select at 0x7f2f2985af70>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:29.678071 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3e2f3a77-fbc7-4d04-92d0-238bb7b0d044 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:29.678982 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3e2f3a77-fbc7-4d04-92d0-238bb7b0d044 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:29.697823 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-2eb24130-16a9-4842-a9bb-18899f380171 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-128653493" status: 202 len: 0 microversion: 2.1 time: 0.031695 Nov 16 00:33:29.698823 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 321/651] 10.222.0.31 () {58 vars in 1217 bytes} [Tue Nov 16 00:33:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-128653493 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:33:29.901079 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-3e2f3a77-fbc7-4d04-92d0-238bb7b0d044 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:29.909818 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-3e2f3a77-fbc7-4d04-92d0-238bb7b0d044 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.259740 Nov 16 00:33:29.911512 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 331/652] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:29 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:29.932444 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a3e83ffc-918b-48f9-9e8c-52733b2e125d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:29.932956 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a3e83ffc-918b-48f9-9e8c-52733b2e125d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:29.939715 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a3e83ffc-918b-48f9-9e8c-52733b2e125d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:29.940168 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a3e83ffc-918b-48f9-9e8c-52733b2e125d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:29.940992 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a3e83ffc-918b-48f9-9e8c-52733b2e125d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:29.941735 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a3e83ffc-918b-48f9-9e8c-52733b2e125d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:30.171545 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a3e83ffc-918b-48f9-9e8c-52733b2e125d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:30.180364 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a3e83ffc-918b-48f9-9e8c-52733b2e125d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1267 microversion: 2.1 time: 0.251974 Nov 16 00:33:30.191286 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 322/653] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:29 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1267 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:30.248196 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-35f11073-e5fb-429a-843e-23e1a62b65cb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:30.249167 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-35f11073-e5fb-429a-843e-23e1a62b65cb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:30.255550 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-35f11073-e5fb-429a-843e-23e1a62b65cb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:30.256445 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-35f11073-e5fb-429a-843e-23e1a62b65cb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:30.257496 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-35f11073-e5fb-429a-843e-23e1a62b65cb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:30.258160 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-35f11073-e5fb-429a-843e-23e1a62b65cb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:30.274709 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-35f11073-e5fb-429a-843e-23e1a62b65cb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] HTTP exception thrown: Instance 3f9b823f-75c2-4baf-9577-5dc85ec77405 could not be found. Nov 16 00:33:30.275456 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-35f11073-e5fb-429a-843e-23e1a62b65cb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Returning 404 to user: Instance 3f9b823f-75c2-4baf-9577-5dc85ec77405 could not be found. {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:33:30.276368 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-35f11073-e5fb-429a-843e-23e1a62b65cb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 404 len: 111 microversion: 2.20 time: 0.031954 Nov 16 00:33:30.277176 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 332/654] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:33:30 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 16 00:33:30.286773 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-87276dd2-36e7-4036-a78b-5103813a3ed6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '.version_select at 0x7f2f295f2670>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:30.310774 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-87276dd2-36e7-4036-a78b-5103813a3ed6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2141648772" status: 204 len: 0 microversion: 2.20 time: 0.028698 Nov 16 00:33:30.312711 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 323/655] 10.222.0.31 () {60 vars in 1261 bytes} [Tue Nov 16 00:33:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2141648772 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 16 00:33:30.701917 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-661ac8bf-3484-47cc-8339-c4bf833f6779 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'create', calling method: .version_select at 0x7f2f2976e4c0>, body: {"keypair": {"name": "tempest-keypair-303541076"}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:30.726934 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-661ac8bf-3484-47cc-8339-c4bf833f6779 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Getting quotas for project a0f2408fc1d043e581cf3406f493b307. Resources: {'key_pairs'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:33:30.732671 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-661ac8bf-3484-47cc-8339-c4bf833f6779 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Getting quotas for user 722e3d22cb754e55aec75f2b8b24ca19 and project a0f2408fc1d043e581cf3406f493b307. Resources: {'key_pairs'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:33:30.914796 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-661ac8bf-3484-47cc-8339-c4bf833f6779 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Getting quotas for project a0f2408fc1d043e581cf3406f493b307. Resources: {'key_pairs'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:33:30.919411 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-661ac8bf-3484-47cc-8339-c4bf833f6779 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Getting quotas for user 722e3d22cb754e55aec75f2b8b24ca19 and project a0f2408fc1d043e581cf3406f493b307. Resources: {'key_pairs'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:33:30.929068 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-7c8c9847-2efe-43a1-9e4d-89bdd5edae3a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:30.930379 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-7c8c9847-2efe-43a1-9e4d-89bdd5edae3a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:30.941341 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7c8c9847-2efe-43a1-9e4d-89bdd5edae3a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:30.941792 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7c8c9847-2efe-43a1-9e4d-89bdd5edae3a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:30.944475 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7c8c9847-2efe-43a1-9e4d-89bdd5edae3a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:30.944940 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7c8c9847-2efe-43a1-9e4d-89bdd5edae3a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:30.977524 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-661ac8bf-3484-47cc-8339-c4bf833f6779 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.280807 Nov 16 00:33:30.979656 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 333/656] 10.222.0.31 () {60 vars in 1157 bytes} [Tue Nov 16 00:33:30 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:30.994721 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f860c990-9711-4b2c-bd4c-811966224b3a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:30.995873 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f860c990-9711-4b2c-bd4c-811966224b3a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: ff1f1755-bb14-4be4-90be-c9b32692635d] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:31.009265 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f860c990-9711-4b2c-bd4c-811966224b3a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:31.010593 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f860c990-9711-4b2c-bd4c-811966224b3a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:31.012469 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f860c990-9711-4b2c-bd4c-811966224b3a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:31.013381 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f860c990-9711-4b2c-bd4c-811966224b3a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:31.153215 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-7c8c9847-2efe-43a1-9e4d-89bdd5edae3a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:31.163615 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-7c8c9847-2efe-43a1-9e4d-89bdd5edae3a tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.238522 Nov 16 00:33:31.164688 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 324/657] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:30 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:31.204266 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.objects.instance [None req-f860c990-9711-4b2c-bd4c-811966224b3a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lazy-loading 'services' on Instance uuid ff1f1755-bb14-4be4-90be-c9b32692635d {{(pid=122543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:33:31.206511 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-ab9ec805-c804-4ad0-ac9b-10e9f76410e4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:31.215335 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-ab9ec805-c804-4ad0-ac9b-10e9f76410e4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:31.226087 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ab9ec805-c804-4ad0-ac9b-10e9f76410e4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:31.227372 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ab9ec805-c804-4ad0-ac9b-10e9f76410e4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:31.229934 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ab9ec805-c804-4ad0-ac9b-10e9f76410e4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:31.232868 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ab9ec805-c804-4ad0-ac9b-10e9f76410e4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:31.292649 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f860c990-9711-4b2c-bd4c-811966224b3a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d/os-volume_attachments/4c7071d8-5871-486f-ade5-808f890e6b63" status: 202 len: 0 microversion: 2.1 time: 0.305186 Nov 16 00:33:31.293240 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 334/658] 10.222.0.31 () {58 vars in 1415 bytes} [Tue Nov 16 00:33:30 2021] DELETE /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d/os-volume_attachments/4c7071d8-5871-486f-ade5-808f890e6b63 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:33:31.349752 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-e8d6386a-96c9-487f-8fd7-298d52715d49 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'create', calling method: .version_select at 0x7f2f296191f0>, body: {"keypair": {"name": "tempest-keypair-565094471"}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:31.377922 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-e8d6386a-96c9-487f-8fd7-298d52715d49 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Getting quotas for project 6a41a4472a974da5aee5d6b458d9f619. Resources: {'key_pairs'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:33:31.395526 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-e8d6386a-96c9-487f-8fd7-298d52715d49 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Getting quotas for user a9913646689d4e678fbb35098466ec8a and project 6a41a4472a974da5aee5d6b458d9f619. Resources: {'key_pairs'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:33:31.453334 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-ab9ec805-c804-4ad0-ac9b-10e9f76410e4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:31.461726 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-ab9ec805-c804-4ad0-ac9b-10e9f76410e4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1267 microversion: 2.1 time: 0.267867 Nov 16 00:33:31.471489 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 325/659] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:31 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1267 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:31.577353 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-e8d6386a-96c9-487f-8fd7-298d52715d49 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Getting quotas for project 6a41a4472a974da5aee5d6b458d9f619. Resources: {'key_pairs'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:33:31.581321 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-e8d6386a-96c9-487f-8fd7-298d52715d49 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Getting quotas for user a9913646689d4e678fbb35098466ec8a and project 6a41a4472a974da5aee5d6b458d9f619. Resources: {'key_pairs'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:33:31.599854 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-e8d6386a-96c9-487f-8fd7-298d52715d49 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.256450 Nov 16 00:33:31.600685 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 335/660] 10.222.0.31 () {62 vars in 1198 bytes} [Tue Nov 16 00:33:31 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 258 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 16 00:33:32.194236 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a4526e60-4ef4-4cf8-8832-d97c8fdc2b85 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:32.195532 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a4526e60-4ef4-4cf8-8832-d97c8fdc2b85 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:32.205714 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a4526e60-4ef4-4cf8-8832-d97c8fdc2b85 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:32.206425 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a4526e60-4ef4-4cf8-8832-d97c8fdc2b85 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:32.208025 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a4526e60-4ef4-4cf8-8832-d97c8fdc2b85 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:32.208705 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a4526e60-4ef4-4cf8-8832-d97c8fdc2b85 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:32.274787 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-3097c499-bfa5-4d01-9e35-bd4f2ffff1d7 req-9c8c3e43-c83d-4946-8719-ceed6aa45f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba21a21-76fa-4a68-b4ec-79454bdc3b4e", "name": "network-vif-plugged", "status": "completed", "tag": "cbec7d92-b961-49b3-8246-e6dad3a5521d"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:32.278981 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:33:32.278981 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:33:32.288436 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-3097c499-bfa5-4d01-9e35-bd4f2ffff1d7 req-9c8c3e43-c83d-4946-8719-ceed6aa45f98 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:32.289372 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-3097c499-bfa5-4d01-9e35-bd4f2ffff1d7 req-9c8c3e43-c83d-4946-8719-ceed6aa45f98 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:32.303845 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-3097c499-bfa5-4d01-9e35-bd4f2ffff1d7 req-9c8c3e43-c83d-4946-8719-ceed6aa45f98 service nova] Creating event network-vif-plugged:cbec7d92-b961-49b3-8246-e6dad3a5521d for instance 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e on hv-cinder-81115 Nov 16 00:33:32.310732 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-3097c499-bfa5-4d01-9e35-bd4f2ffff1d7 req-9c8c3e43-c83d-4946-8719-ceed6aa45f98 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041143 Nov 16 00:33:32.312424 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 336/661] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:33:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:33:32.470714 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a4526e60-4ef4-4cf8-8832-d97c8fdc2b85 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:32.472159 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8456dc3a-dd7d-4fac-a920-5d7c24304928 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:32.475813 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8456dc3a-dd7d-4fac-a920-5d7c24304928 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: ff1f1755-bb14-4be4-90be-c9b32692635d] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:32.487864 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8456dc3a-dd7d-4fac-a920-5d7c24304928 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:32.488284 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8456dc3a-dd7d-4fac-a920-5d7c24304928 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:32.489163 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8456dc3a-dd7d-4fac-a920-5d7c24304928 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:32.489606 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8456dc3a-dd7d-4fac-a920-5d7c24304928 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:32.491429 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a4526e60-4ef4-4cf8-8832-d97c8fdc2b85 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1758 microversion: 2.1 time: 0.301650 Nov 16 00:33:32.492034 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 326/662] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:32 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1758 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:32.509123 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-2e2bbed5-77e7-47ac-acb1-1dc6029c365e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:32.510034 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-2e2bbed5-77e7-47ac-acb1-1dc6029c365e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:32.523118 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8456dc3a-dd7d-4fac-a920-5d7c24304928 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: ff1f1755-bb14-4be4-90be-c9b32692635d] Going to try to terminate instance {{(pid=122543) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:33:32.526020 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2e2bbed5-77e7-47ac-acb1-1dc6029c365e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:32.527698 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2e2bbed5-77e7-47ac-acb1-1dc6029c365e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:32.528747 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2e2bbed5-77e7-47ac-acb1-1dc6029c365e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:32.529337 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2e2bbed5-77e7-47ac-acb1-1dc6029c365e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:32.708361 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8456dc3a-dd7d-4fac-a920-5d7c24304928 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "DELETE /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d" status: 204 len: 0 microversion: 2.1 time: 0.241986 Nov 16 00:33:32.709166 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 337/663] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:33:32 2021] DELETE /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 00:33:32.722519 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-627f5713-6006-4643-815f-2baf22aee027 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:32.723274 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-627f5713-6006-4643-815f-2baf22aee027 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: ff1f1755-bb14-4be4-90be-c9b32692635d] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:32.730213 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-627f5713-6006-4643-815f-2baf22aee027 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:32.730665 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-627f5713-6006-4643-815f-2baf22aee027 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:32.731492 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-627f5713-6006-4643-815f-2baf22aee027 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:32.731917 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-627f5713-6006-4643-815f-2baf22aee027 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:32.818933 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-2e2bbed5-77e7-47ac-acb1-1dc6029c365e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:32.827627 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-2e2bbed5-77e7-47ac-acb1-1dc6029c365e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1267 microversion: 2.1 time: 0.334490 Nov 16 00:33:32.828204 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 327/664] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:32 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1267 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:32.834252 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f8fe835f-c788-45ac-8276-5bb29c7a3bf5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2071423143", "imageRef": "bb47ca05-3b48-4f1c-bc96-e0c5c672caba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3262426f-7c77-4fea-b32e-ea6229d56ca5"}], "security_groups": [{"name": "tempest-securitygroup--2004918572"}], "key_name": "tempest-keypair-303541076", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:32.915217 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-627f5713-6006-4643-815f-2baf22aee027 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:32.922464 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-627f5713-6006-4643-815f-2baf22aee027 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d" status: 200 len: 1514 microversion: 2.1 time: 0.208765 Nov 16 00:33:32.923182 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 338/665] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:32 2021] GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:32.976632 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.network.neutron [None req-f8fe835f-c788-45ac-8276-5bb29c7a3bf5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] validate_networks() for [('3262426f-7c77-4fea-b32e-ea6229d56ca5', None, None, None, None, None)] {{(pid=122544) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:33:33.511739 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-6b488a2a-16d0-4d21-b605-acc4939ce112 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:33.512347 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-6b488a2a-16d0-4d21-b605-acc4939ce112 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:33.518843 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6b488a2a-16d0-4d21-b605-acc4939ce112 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:33.519198 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6b488a2a-16d0-4d21-b605-acc4939ce112 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:33.519976 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6b488a2a-16d0-4d21-b605-acc4939ce112 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:33.520405 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6b488a2a-16d0-4d21-b605-acc4939ce112 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:33.559812 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-f8fe835f-c788-45ac-8276-5bb29c7a3bf5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Flavor limits 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:33:33.560293 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-f8fe835f-c788-45ac-8276-5bb29c7a3bf5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Image limits 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:33:33.560668 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-f8fe835f-c788-45ac-8276-5bb29c7a3bf5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Flavor pref 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:33:33.561063 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-f8fe835f-c788-45ac-8276-5bb29c7a3bf5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Image pref 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:33:33.561460 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-f8fe835f-c788-45ac-8276-5bb29c7a3bf5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:33:33.572259 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f8fe835f-c788-45ac-8276-5bb29c7a3bf5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:33.572840 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f8fe835f-c788-45ac-8276-5bb29c7a3bf5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:33.573654 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f8fe835f-c788-45ac-8276-5bb29c7a3bf5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:33.574086 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f8fe835f-c788-45ac-8276-5bb29c7a3bf5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:33.594130 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-f8fe835f-c788-45ac-8276-5bb29c7a3bf5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Getting quotas for project a0f2408fc1d043e581cf3406f493b307. Resources: {'instances', 'cores', 'ram'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:33:33.599405 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-f8fe835f-c788-45ac-8276-5bb29c7a3bf5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Getting quotas for user 722e3d22cb754e55aec75f2b8b24ca19 and project a0f2408fc1d043e581cf3406f493b307. Resources: {'instances', 'cores', 'ram'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:33:33.613193 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f8fe835f-c788-45ac-8276-5bb29c7a3bf5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Going to run 1 instances... {{(pid=122544) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:33:33.616397 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f8fe835f-c788-45ac-8276-5bb29c7a3bf5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb47ca05-3b48-4f1c-bc96-e0c5c672caba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:33:33.677119 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-6b488a2a-16d0-4d21-b605-acc4939ce112 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:33.690437 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-6b488a2a-16d0-4d21-b605-acc4939ce112 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1761 microversion: 2.1 time: 0.182034 Nov 16 00:33:33.695095 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 339/666] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:33 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1761 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:33.715455 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-f8fe835f-c788-45ac-8276-5bb29c7a3bf5 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.885110 Nov 16 00:33:33.716280 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 328/667] 10.222.0.31 () {60 vars in 1146 bytes} [Tue Nov 16 00:33:32 2021] POST /compute/v2.1/servers => generated 402 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 00:33:33.731366 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-cd43427d-0987-400f-86e1-ad605c6efa58 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:33.732146 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-cd43427d-0987-400f-86e1-ad605c6efa58 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:33.816692 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-cd43427d-0987-400f-86e1-ad605c6efa58 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:33.828646 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-cd43427d-0987-400f-86e1-ad605c6efa58 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383" status: 200 len: 1237 microversion: 2.1 time: 0.101170 Nov 16 00:33:33.833004 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 340/668] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:33 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383 => generated 1237 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:33.846531 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-459f0435-3173-4fe1-81d6-d5d0ec43e249 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:33.847318 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-459f0435-3173-4fe1-81d6-d5d0ec43e249 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:33.857122 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-459f0435-3173-4fe1-81d6-d5d0ec43e249 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:33.857435 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-459f0435-3173-4fe1-81d6-d5d0ec43e249 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:33.858346 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-459f0435-3173-4fe1-81d6-d5d0ec43e249 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:33.858847 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-459f0435-3173-4fe1-81d6-d5d0ec43e249 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:33.939848 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-6582b7cd-b04c-4925-a0de-ed727303de2f tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:33.940722 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-6582b7cd-b04c-4925-a0de-ed727303de2f tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: ff1f1755-bb14-4be4-90be-c9b32692635d] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:33.950209 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6582b7cd-b04c-4925-a0de-ed727303de2f tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:33.950701 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6582b7cd-b04c-4925-a0de-ed727303de2f tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:33.951704 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6582b7cd-b04c-4925-a0de-ed727303de2f tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:33.952184 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6582b7cd-b04c-4925-a0de-ed727303de2f tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:34.109420 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-6582b7cd-b04c-4925-a0de-ed727303de2f tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:34.118851 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-6582b7cd-b04c-4925-a0de-ed727303de2f tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d" status: 200 len: 1514 microversion: 2.1 time: 0.183154 Nov 16 00:33:34.123462 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 341/669] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:33 2021] GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:34.346970 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-459f0435-3173-4fe1-81d6-d5d0ec43e249 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:34.358176 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-459f0435-3173-4fe1-81d6-d5d0ec43e249 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1267 microversion: 2.1 time: 0.516037 Nov 16 00:33:34.368669 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 329/670] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:33 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1267 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:34.503129 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-83763e03-1fc9-4a7f-ae18-804f104493d4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1656126518", "imageRef": "bb47ca05-3b48-4f1c-bc96-e0c5c672caba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8b59832-05f6-4e7c-ada4-45e801ce41ec"}], "security_groups": [{"name": "tempest-securitygroup--1819709799"}], "key_name": "tempest-keypair-565094471", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:34.787509 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.network.neutron [None req-83763e03-1fc9-4a7f-ae18-804f104493d4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] validate_networks() for [('f8b59832-05f6-4e7c-ada4-45e801ce41ec', None, None, None, None, None)] {{(pid=122543) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:33:34.852352 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-cc4546a6-a9a9-4d4d-b8d9-c8a8a26d4a83 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:34.853490 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-cc4546a6-a9a9-4d4d-b8d9-c8a8a26d4a83 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:34.862548 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cc4546a6-a9a9-4d4d-b8d9-c8a8a26d4a83 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:34.862548 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cc4546a6-a9a9-4d4d-b8d9-c8a8a26d4a83 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:34.863069 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cc4546a6-a9a9-4d4d-b8d9-c8a8a26d4a83 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:34.863271 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cc4546a6-a9a9-4d4d-b8d9-c8a8a26d4a83 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:35.163235 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-cc4546a6-a9a9-4d4d-b8d9-c8a8a26d4a83 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:35.171025 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-cc4546a6-a9a9-4d4d-b8d9-c8a8a26d4a83 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383" status: 200 len: 1297 microversion: 2.1 time: 0.326859 Nov 16 00:33:35.171648 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 330/671] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:34 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383 => generated 1297 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:35.186195 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-08868bcf-3246-4d2a-bb5e-c7806ea9f9d7 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:35.186902 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-08868bcf-3246-4d2a-bb5e-c7806ea9f9d7 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: ff1f1755-bb14-4be4-90be-c9b32692635d] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:35.193806 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-08868bcf-3246-4d2a-bb5e-c7806ea9f9d7 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:35.194444 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-08868bcf-3246-4d2a-bb5e-c7806ea9f9d7 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:35.195235 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-08868bcf-3246-4d2a-bb5e-c7806ea9f9d7 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:35.195660 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-08868bcf-3246-4d2a-bb5e-c7806ea9f9d7 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:35.304658 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-08868bcf-3246-4d2a-bb5e-c7806ea9f9d7 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:35.320593 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-08868bcf-3246-4d2a-bb5e-c7806ea9f9d7 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d" status: 200 len: 1472 microversion: 2.1 time: 0.137915 Nov 16 00:33:35.321743 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 331/672] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:35 2021] GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d => generated 1472 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:35.335396 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-b8dbe70f-2576-400d-a722-49bfea10d67d req-c663edb2-e26c-48b7-b130-6af389dc2ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff1f1755-bb14-4be4-90be-c9b32692635d", "name": "network-vif-deleted", "tag": "179c647c-5bc4-406a-80f8-784a650a92d9"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:35.337197 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:33:35.337197 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:33:35.345075 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-b8dbe70f-2576-400d-a722-49bfea10d67d req-c663edb2-e26c-48b7-b130-6af389dc2ec5 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:35.345582 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-b8dbe70f-2576-400d-a722-49bfea10d67d req-c663edb2-e26c-48b7-b130-6af389dc2ec5 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:35.356968 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-b8dbe70f-2576-400d-a722-49bfea10d67d req-c663edb2-e26c-48b7-b130-6af389dc2ec5 service nova] Creating event network-vif-deleted:179c647c-5bc4-406a-80f8-784a650a92d9 for instance ff1f1755-bb14-4be4-90be-c9b32692635d on hv-cinder-81115 Nov 16 00:33:35.363317 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-b8dbe70f-2576-400d-a722-49bfea10d67d req-c663edb2-e26c-48b7-b130-6af389dc2ec5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039900 Nov 16 00:33:35.364156 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 332/673] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:33:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:33:35.374932 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-fcc2417b-02a4-470c-868c-689fccb45cd6 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:35.375873 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-fcc2417b-02a4-470c-868c-689fccb45cd6 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:35.382158 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-fcc2417b-02a4-470c-868c-689fccb45cd6 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:35.382842 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-fcc2417b-02a4-470c-868c-689fccb45cd6 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:35.383968 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-fcc2417b-02a4-470c-868c-689fccb45cd6 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:35.384394 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-fcc2417b-02a4-470c-868c-689fccb45cd6 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:35.518637 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-fcc2417b-02a4-470c-868c-689fccb45cd6 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:35.526622 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-fcc2417b-02a4-470c-868c-689fccb45cd6 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1455 microversion: 2.1 time: 0.155686 Nov 16 00:33:35.527328 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 333/674] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:35 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1455 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:35.547078 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-c376f01f-9d25-4c52-8663-ffd56fc71a1d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:35.547078 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-c376f01f-9d25-4c52-8663-ffd56fc71a1d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:35.552926 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c376f01f-9d25-4c52-8663-ffd56fc71a1d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:35.553598 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c376f01f-9d25-4c52-8663-ffd56fc71a1d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:35.554466 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c376f01f-9d25-4c52-8663-ffd56fc71a1d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:35.554995 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c376f01f-9d25-4c52-8663-ffd56fc71a1d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:35.693085 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-c376f01f-9d25-4c52-8663-ffd56fc71a1d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:35.701908 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-c376f01f-9d25-4c52-8663-ffd56fc71a1d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1455 microversion: 2.1 time: 0.160758 Nov 16 00:33:35.702693 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 334/675] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:35 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1455 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:35.737606 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-83763e03-1fc9-4a7f-ae18-804f104493d4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Flavor limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:33:35.738045 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-83763e03-1fc9-4a7f-ae18-804f104493d4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Image limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:33:35.738550 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-83763e03-1fc9-4a7f-ae18-804f104493d4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Flavor pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:33:35.738949 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-83763e03-1fc9-4a7f-ae18-804f104493d4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Image pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:33:35.739381 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-83763e03-1fc9-4a7f-ae18-804f104493d4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:33:35.750427 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-83763e03-1fc9-4a7f-ae18-804f104493d4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:35.751636 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-83763e03-1fc9-4a7f-ae18-804f104493d4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:35.752705 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-83763e03-1fc9-4a7f-ae18-804f104493d4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:35.753132 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-83763e03-1fc9-4a7f-ae18-804f104493d4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:35.776539 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-83763e03-1fc9-4a7f-ae18-804f104493d4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Getting quotas for project 6a41a4472a974da5aee5d6b458d9f619. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:33:35.782766 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-83763e03-1fc9-4a7f-ae18-804f104493d4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Getting quotas for user a9913646689d4e678fbb35098466ec8a and project 6a41a4472a974da5aee5d6b458d9f619. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:33:35.799465 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-83763e03-1fc9-4a7f-ae18-804f104493d4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Going to run 1 instances... {{(pid=122543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:33:35.802563 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-83763e03-1fc9-4a7f-ae18-804f104493d4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb47ca05-3b48-4f1c-bc96-e0c5c672caba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:33:35.869316 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-83763e03-1fc9-4a7f-ae18-804f104493d4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.370218 Nov 16 00:33:35.869972 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 342/676] 10.222.0.31 () {62 vars in 1187 bytes} [Tue Nov 16 00:33:34 2021] POST /compute/v2.1/servers => generated 402 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 16 00:33:35.880870 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d516887b-5e11-4ce3-b176-d797afcd40b5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:35.881625 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d516887b-5e11-4ce3-b176-d797afcd40b5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:35.954462 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d516887b-5e11-4ce3-b176-d797afcd40b5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:35.964530 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d516887b-5e11-4ce3-b176-d797afcd40b5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:35.967100 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d516887b-5e11-4ce3-b176-d797afcd40b5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:35.968239 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d516887b-5e11-4ce3-b176-d797afcd40b5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1281 microversion: 2.20 time: 0.091294 Nov 16 00:33:35.978454 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 335/677] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:33:35 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1281 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:33:36.195504 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-e4ab813f-6e05-4b91-a690-85c75053a7f0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:36.196315 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-e4ab813f-6e05-4b91-a690-85c75053a7f0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:36.218131 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e4ab813f-6e05-4b91-a690-85c75053a7f0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:36.218696 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e4ab813f-6e05-4b91-a690-85c75053a7f0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:36.219914 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e4ab813f-6e05-4b91-a690-85c75053a7f0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:36.220559 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e4ab813f-6e05-4b91-a690-85c75053a7f0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:36.338009 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-28f459b5-ed47-4ff1-837b-5888570315c2 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:36.339603 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-28f459b5-ed47-4ff1-837b-5888570315c2 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: ff1f1755-bb14-4be4-90be-c9b32692635d] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:36.350842 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-28f459b5-ed47-4ff1-837b-5888570315c2 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:36.351614 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-28f459b5-ed47-4ff1-837b-5888570315c2 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:36.353921 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-28f459b5-ed47-4ff1-837b-5888570315c2 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:36.354605 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-28f459b5-ed47-4ff1-837b-5888570315c2 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:36.372427 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-28f459b5-ed47-4ff1-837b-5888570315c2 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] HTTP exception thrown: Instance ff1f1755-bb14-4be4-90be-c9b32692635d could not be found. Nov 16 00:33:36.373385 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-28f459b5-ed47-4ff1-837b-5888570315c2 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Returning 404 to user: Instance ff1f1755-bb14-4be4-90be-c9b32692635d could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:33:36.374508 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-28f459b5-ed47-4ff1-837b-5888570315c2 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d" status: 404 len: 111 microversion: 2.1 time: 0.040481 Nov 16 00:33:36.379951 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 336/678] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:36 2021] GET /compute/v2.1/servers/ff1f1755-bb14-4be4-90be-c9b32692635d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 00:33:36.504274 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e4ab813f-6e05-4b91-a690-85c75053a7f0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:36.513015 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-e4ab813f-6e05-4b91-a690-85c75053a7f0 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383" status: 200 len: 1363 microversion: 2.1 time: 0.327179 Nov 16 00:33:36.515143 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 343/679] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:36 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383 => generated 1363 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:36.997591 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-687eb884-a94f-4827-bff5-b82a4acbcb9d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:36.998782 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-687eb884-a94f-4827-bff5-b82a4acbcb9d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:37.009731 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-687eb884-a94f-4827-bff5-b82a4acbcb9d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:37.010407 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-687eb884-a94f-4827-bff5-b82a4acbcb9d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:37.011951 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-687eb884-a94f-4827-bff5-b82a4acbcb9d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:37.013120 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-687eb884-a94f-4827-bff5-b82a4acbcb9d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:37.100681 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-f2313b46-fe94-4a98-8c70-9c80a79d5582 req-c3e035f7-1a62-4ba2-b29c-43e3306566ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1720981e-6170-4ee8-b78c-8ecc7b7e3383", "tag": "21a8ef86-9f54-4c01-abcd-c55fd2b5049c"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:37.102258 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:33:37.102258 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:33:37.105961 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-687eb884-a94f-4827-bff5-b82a4acbcb9d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:37.109551 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-f2313b46-fe94-4a98-8c70-9c80a79d5582 req-c3e035f7-1a62-4ba2-b29c-43e3306566ac service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:37.110764 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-f2313b46-fe94-4a98-8c70-9c80a79d5582 req-c3e035f7-1a62-4ba2-b29c-43e3306566ac service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:37.124452 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-687eb884-a94f-4827-bff5-b82a4acbcb9d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:37.128082 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-687eb884-a94f-4827-bff5-b82a4acbcb9d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:37.130900 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-687eb884-a94f-4827-bff5-b82a4acbcb9d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1333 microversion: 2.20 time: 0.137143 Nov 16 00:33:37.141664 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 337/680] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:33:36 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1333 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:33:37.149542 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-f2313b46-fe94-4a98-8c70-9c80a79d5582 req-c3e035f7-1a62-4ba2-b29c-43e3306566ac service nova] Creating event network-changed:21a8ef86-9f54-4c01-abcd-c55fd2b5049c for instance 1720981e-6170-4ee8-b78c-8ecc7b7e3383 on hv-cinder-81115 Nov 16 00:33:37.157211 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-f2313b46-fe94-4a98-8c70-9c80a79d5582 req-c3e035f7-1a62-4ba2-b29c-43e3306566ac service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059489 Nov 16 00:33:37.158405 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 344/681] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:33:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:33:37.532398 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-6da8c9c9-aedf-45a2-8488-b29ae11c1ddd tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:37.533282 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-6da8c9c9-aedf-45a2-8488-b29ae11c1ddd tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:37.539428 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6da8c9c9-aedf-45a2-8488-b29ae11c1ddd tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:37.539871 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6da8c9c9-aedf-45a2-8488-b29ae11c1ddd tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:37.540637 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6da8c9c9-aedf-45a2-8488-b29ae11c1ddd tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:37.541069 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6da8c9c9-aedf-45a2-8488-b29ae11c1ddd tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:37.757018 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-6da8c9c9-aedf-45a2-8488-b29ae11c1ddd tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:37.765662 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-6da8c9c9-aedf-45a2-8488-b29ae11c1ddd tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383" status: 200 len: 1363 microversion: 2.1 time: 0.237500 Nov 16 00:33:37.775288 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 338/682] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:37 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:38.150458 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-3c29b921-f912-4f40-9411-ea214787b0f3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:38.151452 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-3c29b921-f912-4f40-9411-ea214787b0f3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:38.157325 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3c29b921-f912-4f40-9411-ea214787b0f3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:38.157774 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3c29b921-f912-4f40-9411-ea214787b0f3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:38.159273 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3c29b921-f912-4f40-9411-ea214787b0f3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:38.159910 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3c29b921-f912-4f40-9411-ea214787b0f3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:38.209234 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-9b2cde7b-990e-44ae-a5cb-b7c67bb20a27 req-92a245d7-7a6d-4f6b-9b2d-6d0547672634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba21a21-76fa-4a68-b4ec-79454bdc3b4e", "tag": "cbec7d92-b961-49b3-8246-e6dad3a5521d"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:38.211575 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:33:38.211575 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:33:38.219286 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-9b2cde7b-990e-44ae-a5cb-b7c67bb20a27 req-92a245d7-7a6d-4f6b-9b2d-6d0547672634 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:38.220589 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-9b2cde7b-990e-44ae-a5cb-b7c67bb20a27 req-92a245d7-7a6d-4f6b-9b2d-6d0547672634 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:38.235737 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-9b2cde7b-990e-44ae-a5cb-b7c67bb20a27 req-92a245d7-7a6d-4f6b-9b2d-6d0547672634 service nova] Creating event network-changed:cbec7d92-b961-49b3-8246-e6dad3a5521d for instance 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e on hv-cinder-81115 Nov 16 00:33:38.236141 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-3c29b921-f912-4f40-9411-ea214787b0f3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:38.241230 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-9b2cde7b-990e-44ae-a5cb-b7c67bb20a27 req-92a245d7-7a6d-4f6b-9b2d-6d0547672634 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036124 Nov 16 00:33:38.242239 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 339/683] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:33:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:33:38.247443 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-3c29b921-f912-4f40-9411-ea214787b0f3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:38.249566 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-3c29b921-f912-4f40-9411-ea214787b0f3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:38.251266 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-3c29b921-f912-4f40-9411-ea214787b0f3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1333 microversion: 2.20 time: 0.105519 Nov 16 00:33:38.251908 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 345/684] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:33:38 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1333 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:33:38.784836 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-300327c8-9f55-48d7-bc44-d7fc52cc2299 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:38.785538 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-300327c8-9f55-48d7-bc44-d7fc52cc2299 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:38.792048 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-300327c8-9f55-48d7-bc44-d7fc52cc2299 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:38.792498 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-300327c8-9f55-48d7-bc44-d7fc52cc2299 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:38.793338 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-300327c8-9f55-48d7-bc44-d7fc52cc2299 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:38.793771 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-300327c8-9f55-48d7-bc44-d7fc52cc2299 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:38.930077 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-300327c8-9f55-48d7-bc44-d7fc52cc2299 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:38.941607 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-300327c8-9f55-48d7-bc44-d7fc52cc2299 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383" status: 200 len: 1363 microversion: 2.1 time: 0.161671 Nov 16 00:33:38.942405 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 340/685] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:38 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:39.270189 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1749171e-572b-4b53-97e5-885cd6206fc6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:39.270895 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1749171e-572b-4b53-97e5-885cd6206fc6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:39.276930 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1749171e-572b-4b53-97e5-885cd6206fc6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:39.277446 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1749171e-572b-4b53-97e5-885cd6206fc6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:39.278280 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1749171e-572b-4b53-97e5-885cd6206fc6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:39.278773 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1749171e-572b-4b53-97e5-885cd6206fc6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:39.342309 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-1749171e-572b-4b53-97e5-885cd6206fc6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:39.350857 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-1749171e-572b-4b53-97e5-885cd6206fc6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:39.352363 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-1749171e-572b-4b53-97e5-885cd6206fc6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:39.353441 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-1749171e-572b-4b53-97e5-885cd6206fc6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1333 microversion: 2.20 time: 0.088321 Nov 16 00:33:39.353986 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 346/686] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:33:39 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1333 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:33:39.961169 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-789c6936-cc89-47a7-9136-d9591e7b6df7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:39.961789 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-789c6936-cc89-47a7-9136-d9591e7b6df7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:39.969363 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-789c6936-cc89-47a7-9136-d9591e7b6df7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:39.970044 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-789c6936-cc89-47a7-9136-d9591e7b6df7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:39.971034 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-789c6936-cc89-47a7-9136-d9591e7b6df7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:39.971683 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-789c6936-cc89-47a7-9136-d9591e7b6df7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:40.194217 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-789c6936-cc89-47a7-9136-d9591e7b6df7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:40.202866 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-789c6936-cc89-47a7-9136-d9591e7b6df7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383" status: 200 len: 1363 microversion: 2.1 time: 0.246018 Nov 16 00:33:40.215515 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 341/687] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:39 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:40.371860 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-6c44dce9-a3a8-4d76-bf4e-165bfed01ac9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:40.372485 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-6c44dce9-a3a8-4d76-bf4e-165bfed01ac9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:40.379313 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6c44dce9-a3a8-4d76-bf4e-165bfed01ac9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:40.379852 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6c44dce9-a3a8-4d76-bf4e-165bfed01ac9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:40.380710 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6c44dce9-a3a8-4d76-bf4e-165bfed01ac9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:40.381205 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6c44dce9-a3a8-4d76-bf4e-165bfed01ac9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:40.494303 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-6c44dce9-a3a8-4d76-bf4e-165bfed01ac9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:40.503399 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-6c44dce9-a3a8-4d76-bf4e-165bfed01ac9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:40.504910 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-6c44dce9-a3a8-4d76-bf4e-165bfed01ac9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:40.506101 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-6c44dce9-a3a8-4d76-bf4e-165bfed01ac9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1339 microversion: 2.20 time: 0.137980 Nov 16 00:33:40.506597 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 347/688] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:33:40 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1339 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:33:41.223000 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-1a99e6a5-1c2b-405d-a405-668dbc3a2dec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:41.223744 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-1a99e6a5-1c2b-405d-a405-668dbc3a2dec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:41.232681 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1a99e6a5-1c2b-405d-a405-668dbc3a2dec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:41.233941 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1a99e6a5-1c2b-405d-a405-668dbc3a2dec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:41.235663 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1a99e6a5-1c2b-405d-a405-668dbc3a2dec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:41.236534 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1a99e6a5-1c2b-405d-a405-668dbc3a2dec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:41.372530 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-1a99e6a5-1c2b-405d-a405-668dbc3a2dec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:41.381219 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-1a99e6a5-1c2b-405d-a405-668dbc3a2dec tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383" status: 200 len: 1363 microversion: 2.1 time: 0.162156 Nov 16 00:33:41.381808 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 342/689] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:41 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:41.524142 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c9b1b155-4023-4575-8401-0e294f367399 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:41.524747 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c9b1b155-4023-4575-8401-0e294f367399 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:41.534507 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c9b1b155-4023-4575-8401-0e294f367399 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:41.535251 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c9b1b155-4023-4575-8401-0e294f367399 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:41.537121 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c9b1b155-4023-4575-8401-0e294f367399 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:41.537714 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c9b1b155-4023-4575-8401-0e294f367399 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:41.723636 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c9b1b155-4023-4575-8401-0e294f367399 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:41.732333 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c9b1b155-4023-4575-8401-0e294f367399 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:41.734017 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c9b1b155-4023-4575-8401-0e294f367399 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:41.736025 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c9b1b155-4023-4575-8401-0e294f367399 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1407 microversion: 2.20 time: 0.215489 Nov 16 00:33:41.736754 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 348/690] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:33:41 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:33:41.822836 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-7860cfb3-7087-4fac-a4bd-247f3bb094be req-72ee35cf-fe16-430d-a234-f065b5e775b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cabac73-4f43-4f58-941d-fcde21d2fdf2", "tag": "24c138f4-ee49-4e30-8553-2bc8c5029b8d"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:41.824743 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:33:41.824743 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:33:41.833214 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-7860cfb3-7087-4fac-a4bd-247f3bb094be req-72ee35cf-fe16-430d-a234-f065b5e775b9 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:41.833652 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-7860cfb3-7087-4fac-a4bd-247f3bb094be req-72ee35cf-fe16-430d-a234-f065b5e775b9 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:41.855842 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-7860cfb3-7087-4fac-a4bd-247f3bb094be req-72ee35cf-fe16-430d-a234-f065b5e775b9 service nova] Creating event network-changed:24c138f4-ee49-4e30-8553-2bc8c5029b8d for instance 5cabac73-4f43-4f58-941d-fcde21d2fdf2 on hv-cinder-81115 Nov 16 00:33:41.865246 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-7860cfb3-7087-4fac-a4bd-247f3bb094be req-72ee35cf-fe16-430d-a234-f065b5e775b9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045576 Nov 16 00:33:41.866327 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 343/691] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:33:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:33:42.398375 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f2ec9fbc-d70e-47b9-b66a-e6b6181e69c8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:42.398982 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f2ec9fbc-d70e-47b9-b66a-e6b6181e69c8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:42.405029 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f2ec9fbc-d70e-47b9-b66a-e6b6181e69c8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:42.405475 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f2ec9fbc-d70e-47b9-b66a-e6b6181e69c8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:42.406264 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f2ec9fbc-d70e-47b9-b66a-e6b6181e69c8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:42.406779 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f2ec9fbc-d70e-47b9-b66a-e6b6181e69c8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:42.541550 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f2ec9fbc-d70e-47b9-b66a-e6b6181e69c8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:42.551476 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f2ec9fbc-d70e-47b9-b66a-e6b6181e69c8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383" status: 200 len: 1363 microversion: 2.1 time: 0.156809 Nov 16 00:33:42.552058 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 349/692] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:42 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:42.756643 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3749a76f-19a2-4a06-b8fa-440fd295d948 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:42.757346 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3749a76f-19a2-4a06-b8fa-440fd295d948 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:42.764312 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3749a76f-19a2-4a06-b8fa-440fd295d948 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:42.764756 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3749a76f-19a2-4a06-b8fa-440fd295d948 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:42.765540 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3749a76f-19a2-4a06-b8fa-440fd295d948 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:42.766083 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3749a76f-19a2-4a06-b8fa-440fd295d948 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:42.904124 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3749a76f-19a2-4a06-b8fa-440fd295d948 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:42.913384 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3749a76f-19a2-4a06-b8fa-440fd295d948 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:42.915134 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3749a76f-19a2-4a06-b8fa-440fd295d948 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:42.916232 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-3749a76f-19a2-4a06-b8fa-440fd295d948 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1407 microversion: 2.20 time: 0.164153 Nov 16 00:33:42.916801 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 344/693] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:33:42 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:33:43.569389 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-865163e5-0adf-485b-9200-b2de04c5259d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:43.570078 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-865163e5-0adf-485b-9200-b2de04c5259d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:43.575914 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-865163e5-0adf-485b-9200-b2de04c5259d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:43.576384 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-865163e5-0adf-485b-9200-b2de04c5259d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:43.577156 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-865163e5-0adf-485b-9200-b2de04c5259d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:43.577591 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-865163e5-0adf-485b-9200-b2de04c5259d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:43.700216 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-865163e5-0adf-485b-9200-b2de04c5259d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:43.708071 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-865163e5-0adf-485b-9200-b2de04c5259d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383" status: 200 len: 1363 microversion: 2.1 time: 0.141874 Nov 16 00:33:43.708272 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 350/694] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:43 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383 => generated 1363 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:43.934337 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-df2c8385-b3f3-4692-a06b-82f524d85f35 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:43.934879 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-df2c8385-b3f3-4692-a06b-82f524d85f35 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:43.940942 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-df2c8385-b3f3-4692-a06b-82f524d85f35 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:43.941384 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-df2c8385-b3f3-4692-a06b-82f524d85f35 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:43.942155 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-df2c8385-b3f3-4692-a06b-82f524d85f35 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:43.942579 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-df2c8385-b3f3-4692-a06b-82f524d85f35 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:44.071356 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-df2c8385-b3f3-4692-a06b-82f524d85f35 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:44.079993 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-df2c8385-b3f3-4692-a06b-82f524d85f35 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:44.081482 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-df2c8385-b3f3-4692-a06b-82f524d85f35 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:44.082588 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-df2c8385-b3f3-4692-a06b-82f524d85f35 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1407 microversion: 2.20 time: 0.152092 Nov 16 00:33:44.083165 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 345/695] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:33:43 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:33:44.424881 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-b46a65e3-320a-4af6-a2a8-760a057cb06c tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-142610141", "imageRef": "bb47ca05-3b48-4f1c-bc96-e0c5c672caba", "flavorRef": "452", "networks": [{"uuid": "5bc8079a-b087-4e35-8fba-022dbaf3b750"}]}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:44.480181 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.network.neutron [None req-b46a65e3-320a-4af6-a2a8-760a057cb06c tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] validate_networks() for [('5bc8079a-b087-4e35-8fba-022dbaf3b750', None, None, None, None, None)] {{(pid=122543) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:33:44.726601 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-c283024b-3af6-400e-8b1e-f3128b85a49d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:44.727312 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-c283024b-3af6-400e-8b1e-f3128b85a49d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:44.733162 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c283024b-3af6-400e-8b1e-f3128b85a49d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:44.733682 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c283024b-3af6-400e-8b1e-f3128b85a49d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:44.736719 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c283024b-3af6-400e-8b1e-f3128b85a49d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:44.737232 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c283024b-3af6-400e-8b1e-f3128b85a49d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:44.880696 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-c283024b-3af6-400e-8b1e-f3128b85a49d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:44.887847 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-c283024b-3af6-400e-8b1e-f3128b85a49d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383" status: 200 len: 1363 microversion: 2.1 time: 0.166804 Nov 16 00:33:44.888493 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 346/696] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:44 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:45.038610 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-b46a65e3-320a-4af6-a2a8-760a057cb06c tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Flavor limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:33:45.039124 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-b46a65e3-320a-4af6-a2a8-760a057cb06c tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Image limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:33:45.039579 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-b46a65e3-320a-4af6-a2a8-760a057cb06c tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Flavor pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:33:45.039984 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-b46a65e3-320a-4af6-a2a8-760a057cb06c tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Image pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:33:45.040394 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-b46a65e3-320a-4af6-a2a8-760a057cb06c tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:33:45.049737 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b46a65e3-320a-4af6-a2a8-760a057cb06c tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:45.050185 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b46a65e3-320a-4af6-a2a8-760a057cb06c tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:45.050989 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b46a65e3-320a-4af6-a2a8-760a057cb06c tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:45.051457 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b46a65e3-320a-4af6-a2a8-760a057cb06c tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:45.070792 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-b46a65e3-320a-4af6-a2a8-760a057cb06c tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Getting quotas for project 4ea54a26354e40baac7af6061517ccf4. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:33:45.074801 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-b46a65e3-320a-4af6-a2a8-760a057cb06c tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Getting quotas for user dc4b2e84db43455d843f4b322fae785e and project 4ea54a26354e40baac7af6061517ccf4. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:33:45.086455 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b46a65e3-320a-4af6-a2a8-760a057cb06c tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Going to run 1 instances... {{(pid=122543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:33:45.088743 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b46a65e3-320a-4af6-a2a8-760a057cb06c tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: 746c2aa8-ae92-4f51-8664-f9e4a7be7412] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb47ca05-3b48-4f1c-bc96-e0c5c672caba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:33:45.100821 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0f95e677-ed65-420b-bcd5-3c1cd84ac69f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:45.101522 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0f95e677-ed65-420b-bcd5-3c1cd84ac69f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:45.107338 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0f95e677-ed65-420b-bcd5-3c1cd84ac69f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:45.107858 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0f95e677-ed65-420b-bcd5-3c1cd84ac69f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:45.108692 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0f95e677-ed65-420b-bcd5-3c1cd84ac69f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:45.109191 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0f95e677-ed65-420b-bcd5-3c1cd84ac69f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:45.139797 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-b46a65e3-320a-4af6-a2a8-760a057cb06c tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718567 Nov 16 00:33:45.145927 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 351/697] 10.222.0.31 () {60 vars in 1146 bytes} [Tue Nov 16 00:33:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 00:33:45.152870 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-cc15db46-4713-4843-9b67-8338ef6aa334 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:45.154491 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-cc15db46-4713-4843-9b67-8338ef6aa334 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: 746c2aa8-ae92-4f51-8664-f9e4a7be7412] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:45.226176 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-cc15db46-4713-4843-9b67-8338ef6aa334 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:45.244412 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-cc15db46-4713-4843-9b67-8338ef6aa334 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412" status: 200 len: 1218 microversion: 2.1 time: 0.096652 Nov 16 00:33:45.250548 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 352/698] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:45 2021] GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:45.315443 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0f95e677-ed65-420b-bcd5-3c1cd84ac69f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:45.326173 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0f95e677-ed65-420b-bcd5-3c1cd84ac69f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:45.329513 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0f95e677-ed65-420b-bcd5-3c1cd84ac69f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:45.331670 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0f95e677-ed65-420b-bcd5-3c1cd84ac69f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1407 microversion: 2.20 time: 0.234363 Nov 16 00:33:45.332812 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 347/699] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:33:45 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:33:45.347963 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-0ec41303-56ca-453c-846e-bb2e3e855c7d req-56457b1f-0abe-40f4-8c1c-31c5d30d15f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1720981e-6170-4ee8-b78c-8ecc7b7e3383", "name": "network-vif-plugged", "status": "completed", "tag": "21a8ef86-9f54-4c01-abcd-c55fd2b5049c"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:45.350189 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:33:45.350189 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:33:45.361077 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-0ec41303-56ca-453c-846e-bb2e3e855c7d req-56457b1f-0abe-40f4-8c1c-31c5d30d15f8 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:45.361610 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-0ec41303-56ca-453c-846e-bb2e3e855c7d req-56457b1f-0abe-40f4-8c1c-31c5d30d15f8 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:45.372795 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-0ec41303-56ca-453c-846e-bb2e3e855c7d req-56457b1f-0abe-40f4-8c1c-31c5d30d15f8 service nova] Creating event network-vif-plugged:21a8ef86-9f54-4c01-abcd-c55fd2b5049c for instance 1720981e-6170-4ee8-b78c-8ecc7b7e3383 on hv-cinder-81115 Nov 16 00:33:45.379804 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-0ec41303-56ca-453c-846e-bb2e3e855c7d req-56457b1f-0abe-40f4-8c1c-31c5d30d15f8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044018 Nov 16 00:33:45.381181 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 353/700] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:33:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:33:45.905352 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-54b44797-b217-4fef-bc77-d272f853206c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:45.905861 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-54b44797-b217-4fef-bc77-d272f853206c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:45.912118 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-54b44797-b217-4fef-bc77-d272f853206c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:45.912558 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-54b44797-b217-4fef-bc77-d272f853206c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:45.913332 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-54b44797-b217-4fef-bc77-d272f853206c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:45.913757 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-54b44797-b217-4fef-bc77-d272f853206c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:46.042924 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-54b44797-b217-4fef-bc77-d272f853206c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:46.050357 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-54b44797-b217-4fef-bc77-d272f853206c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383" status: 200 len: 1363 microversion: 2.1 time: 0.149045 Nov 16 00:33:46.050946 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 348/701] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:45 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:46.264913 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-4b75ebca-7c16-4fe8-bbc8-01f9832bfea9 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:46.265518 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-4b75ebca-7c16-4fe8-bbc8-01f9832bfea9 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: 746c2aa8-ae92-4f51-8664-f9e4a7be7412] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:46.272247 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4b75ebca-7c16-4fe8-bbc8-01f9832bfea9 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:46.272688 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4b75ebca-7c16-4fe8-bbc8-01f9832bfea9 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:46.273457 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4b75ebca-7c16-4fe8-bbc8-01f9832bfea9 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:46.273886 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4b75ebca-7c16-4fe8-bbc8-01f9832bfea9 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:46.336926 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-4b75ebca-7c16-4fe8-bbc8-01f9832bfea9 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:46.344057 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-4b75ebca-7c16-4fe8-bbc8-01f9832bfea9 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412" status: 200 len: 1270 microversion: 2.1 time: 0.083312 Nov 16 00:33:46.354159 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 354/702] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:46 2021] GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:46.354347 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-298f24fc-7fae-4221-9858-5b424529992d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:46.354347 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-298f24fc-7fae-4221-9858-5b424529992d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:46.356384 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-298f24fc-7fae-4221-9858-5b424529992d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:46.356833 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-298f24fc-7fae-4221-9858-5b424529992d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:46.357590 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-298f24fc-7fae-4221-9858-5b424529992d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:46.358021 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-298f24fc-7fae-4221-9858-5b424529992d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:46.483935 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-298f24fc-7fae-4221-9858-5b424529992d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:46.493071 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-298f24fc-7fae-4221-9858-5b424529992d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:46.494580 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-298f24fc-7fae-4221-9858-5b424529992d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:46.495726 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-298f24fc-7fae-4221-9858-5b424529992d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1407 microversion: 2.20 time: 0.149657 Nov 16 00:33:46.496317 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 349/703] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:33:46 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:33:47.068469 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-2b7be49b-e496-416d-bd16-2a106ba0ca3d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:47.069383 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-2b7be49b-e496-416d-bd16-2a106ba0ca3d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:47.076847 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2b7be49b-e496-416d-bd16-2a106ba0ca3d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:47.077420 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2b7be49b-e496-416d-bd16-2a106ba0ca3d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:47.080067 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2b7be49b-e496-416d-bd16-2a106ba0ca3d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:47.080771 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2b7be49b-e496-416d-bd16-2a106ba0ca3d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:47.323891 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2b7be49b-e496-416d-bd16-2a106ba0ca3d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:47.332603 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-2b7be49b-e496-416d-bd16-2a106ba0ca3d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383" status: 200 len: 1548 microversion: 2.1 time: 0.268500 Nov 16 00:33:47.333439 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 355/704] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:47 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383 => generated 1548 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:47.349745 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0e55719c-2d1a-4e19-a90b-6f42474e85b9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:47.350248 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0e55719c-2d1a-4e19-a90b-6f42474e85b9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:47.357260 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0e55719c-2d1a-4e19-a90b-6f42474e85b9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:47.358532 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0e55719c-2d1a-4e19-a90b-6f42474e85b9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:47.359718 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0e55719c-2d1a-4e19-a90b-6f42474e85b9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:47.360649 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0e55719c-2d1a-4e19-a90b-6f42474e85b9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:47.362992 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-003d9b20-30ea-427e-aae7-c89b00c1125f tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:47.363639 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-003d9b20-30ea-427e-aae7-c89b00c1125f tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: 746c2aa8-ae92-4f51-8664-f9e4a7be7412] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:47.371178 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-003d9b20-30ea-427e-aae7-c89b00c1125f tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:47.371940 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-003d9b20-30ea-427e-aae7-c89b00c1125f tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:47.373074 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-003d9b20-30ea-427e-aae7-c89b00c1125f tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:47.373721 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-003d9b20-30ea-427e-aae7-c89b00c1125f tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:47.461253 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0e55719c-2d1a-4e19-a90b-6f42474e85b9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115621 Nov 16 00:33:47.461860 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 350/705] 10.222.0.31 () {58 vars in 1274 bytes} [Tue Nov 16 00:33:47 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:33:47.515177 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e275ad71-4d4f-4111-8b71-fc8bf98129d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:47.517581 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e275ad71-4d4f-4111-8b71-fc8bf98129d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:47.524247 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e275ad71-4d4f-4111-8b71-fc8bf98129d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:47.524915 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e275ad71-4d4f-4111-8b71-fc8bf98129d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:47.525776 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e275ad71-4d4f-4111-8b71-fc8bf98129d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:47.526310 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e275ad71-4d4f-4111-8b71-fc8bf98129d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:47.628439 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-003d9b20-30ea-427e-aae7-c89b00c1125f tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:47.638710 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-003d9b20-30ea-427e-aae7-c89b00c1125f tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412" status: 200 len: 1318 microversion: 2.1 time: 0.280596 Nov 16 00:33:47.639997 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 356/706] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:47 2021] GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:47.864772 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e275ad71-4d4f-4111-8b71-fc8bf98129d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:47.879169 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e275ad71-4d4f-4111-8b71-fc8bf98129d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:47.882243 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e275ad71-4d4f-4111-8b71-fc8bf98129d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:47.884444 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e275ad71-4d4f-4111-8b71-fc8bf98129d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1407 microversion: 2.20 time: 0.373003 Nov 16 00:33:47.885476 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 351/707] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:33:47 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1407 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:33:48.042982 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-af1f78bf-1de4-4585-a9ab-abc282ca7b77 req-d58aa684-2bb4-4aa1-a99a-fc5582c49335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "746c2aa8-ae92-4f51-8664-f9e4a7be7412", "tag": "0c36d8f3-6603-4623-848c-4d093b88f363"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:48.044754 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:33:48.044754 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:33:48.052465 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-af1f78bf-1de4-4585-a9ab-abc282ca7b77 req-d58aa684-2bb4-4aa1-a99a-fc5582c49335 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:48.052912 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-af1f78bf-1de4-4585-a9ab-abc282ca7b77 req-d58aa684-2bb4-4aa1-a99a-fc5582c49335 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:48.073527 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-af1f78bf-1de4-4585-a9ab-abc282ca7b77 req-d58aa684-2bb4-4aa1-a99a-fc5582c49335 service nova] Creating event network-changed:0c36d8f3-6603-4623-848c-4d093b88f363 for instance 746c2aa8-ae92-4f51-8664-f9e4a7be7412 on hv-cinder-81115 Nov 16 00:33:48.080132 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-af1f78bf-1de4-4585-a9ab-abc282ca7b77 req-d58aa684-2bb4-4aa1-a99a-fc5582c49335 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040797 Nov 16 00:33:48.080729 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 357/708] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:33:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:33:48.588558 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-508c917d-d72e-4774-b94f-f0ee060798ff tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:48.594787 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-370c9eaf-269e-4c21-b23b-a25767e788a3 req-30690731-0c1d-4974-9471-8df85c77b2b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1720981e-6170-4ee8-b78c-8ecc7b7e3383", "tag": "21a8ef86-9f54-4c01-abcd-c55fd2b5049c"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:48.596441 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-508c917d-d72e-4774-b94f-f0ee060798ff tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:48.596578 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:33:48.596578 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:33:48.604562 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-508c917d-d72e-4774-b94f-f0ee060798ff tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:48.605013 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-508c917d-d72e-4774-b94f-f0ee060798ff tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:48.606079 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-508c917d-d72e-4774-b94f-f0ee060798ff tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:48.606775 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-508c917d-d72e-4774-b94f-f0ee060798ff tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:48.607182 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-370c9eaf-269e-4c21-b23b-a25767e788a3 req-30690731-0c1d-4974-9471-8df85c77b2b5 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:48.607699 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-370c9eaf-269e-4c21-b23b-a25767e788a3 req-30690731-0c1d-4974-9471-8df85c77b2b5 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:48.620168 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-370c9eaf-269e-4c21-b23b-a25767e788a3 req-30690731-0c1d-4974-9471-8df85c77b2b5 service nova] Creating event network-changed:21a8ef86-9f54-4c01-abcd-c55fd2b5049c for instance 1720981e-6170-4ee8-b78c-8ecc7b7e3383 on hv-cinder-81115 Nov 16 00:33:48.625655 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-370c9eaf-269e-4c21-b23b-a25767e788a3 req-30690731-0c1d-4974-9471-8df85c77b2b5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035325 Nov 16 00:33:48.626336 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 358/709] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:33:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:33:48.657494 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-62e8e035-3b2f-4e1a-8d95-66755b0a3ad8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:48.658194 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-62e8e035-3b2f-4e1a-8d95-66755b0a3ad8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: 746c2aa8-ae92-4f51-8664-f9e4a7be7412] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:48.664797 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-62e8e035-3b2f-4e1a-8d95-66755b0a3ad8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:48.665314 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-62e8e035-3b2f-4e1a-8d95-66755b0a3ad8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:48.666111 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-62e8e035-3b2f-4e1a-8d95-66755b0a3ad8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:48.666549 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-62e8e035-3b2f-4e1a-8d95-66755b0a3ad8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:48.690210 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-508c917d-d72e-4774-b94f-f0ee060798ff tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 14 microversion: 2.1 time: 0.105202 Nov 16 00:33:48.693912 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 352/710] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:33:48 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:33:48.904416 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-7f12df0b-e041-48a0-bdf2-648526524130 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:48.905523 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-7f12df0b-e041-48a0-bdf2-648526524130 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:48.913517 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7f12df0b-e041-48a0-bdf2-648526524130 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:48.914259 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7f12df0b-e041-48a0-bdf2-648526524130 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:48.916233 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7f12df0b-e041-48a0-bdf2-648526524130 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:48.916753 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7f12df0b-e041-48a0-bdf2-648526524130 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:49.010213 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-62e8e035-3b2f-4e1a-8d95-66755b0a3ad8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:49.021373 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-62e8e035-3b2f-4e1a-8d95-66755b0a3ad8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412" status: 200 len: 1318 microversion: 2.1 time: 0.368245 Nov 16 00:33:49.032583 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 359/711] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:48 2021] GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:49.053810 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-7f12df0b-e041-48a0-bdf2-648526524130 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:49.063453 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-7f12df0b-e041-48a0-bdf2-648526524130 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:49.065095 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-7f12df0b-e041-48a0-bdf2-648526524130 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:49.066161 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-7f12df0b-e041-48a0-bdf2-648526524130 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1407 microversion: 2.20 time: 0.165982 Nov 16 00:33:49.076463 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 353/712] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:33:48 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:33:49.535876 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-cf2ab571-58a5-4774-ba3a-a75e487a7a5a req-3eef7acc-9c59-4b82-8770-af12a49ceda4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cabac73-4f43-4f58-941d-fcde21d2fdf2", "name": "network-vif-plugged", "status": "completed", "tag": "24c138f4-ee49-4e30-8553-2bc8c5029b8d"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:49.537883 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:33:49.537883 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:33:49.546475 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-cf2ab571-58a5-4774-ba3a-a75e487a7a5a req-3eef7acc-9c59-4b82-8770-af12a49ceda4 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:49.548625 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-cf2ab571-58a5-4774-ba3a-a75e487a7a5a req-3eef7acc-9c59-4b82-8770-af12a49ceda4 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:49.558850 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-cf2ab571-58a5-4774-ba3a-a75e487a7a5a req-3eef7acc-9c59-4b82-8770-af12a49ceda4 service nova] Creating event network-vif-plugged:24c138f4-ee49-4e30-8553-2bc8c5029b8d for instance 5cabac73-4f43-4f58-941d-fcde21d2fdf2 on hv-cinder-81115 Nov 16 00:33:49.565118 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-cf2ab571-58a5-4774-ba3a-a75e487a7a5a req-3eef7acc-9c59-4b82-8770-af12a49ceda4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032797 Nov 16 00:33:49.566172 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 360/713] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:33:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:33:49.701043 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-beafc465-e6fe-41ec-952d-8d31095288c1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:49.702053 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-beafc465-e6fe-41ec-952d-8d31095288c1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:49.708523 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-beafc465-e6fe-41ec-952d-8d31095288c1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:49.709266 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-beafc465-e6fe-41ec-952d-8d31095288c1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:49.710258 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-beafc465-e6fe-41ec-952d-8d31095288c1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:49.710886 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-beafc465-e6fe-41ec-952d-8d31095288c1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:49.777823 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-beafc465-e6fe-41ec-952d-8d31095288c1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 14 microversion: 2.1 time: 0.080276 Nov 16 00:33:49.778580 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 354/714] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:33:49 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:33:50.039173 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-faf65081-c397-4959-9e4e-13d5051a6dbf tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:50.039863 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-faf65081-c397-4959-9e4e-13d5051a6dbf tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: 746c2aa8-ae92-4f51-8664-f9e4a7be7412] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:50.045931 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-faf65081-c397-4959-9e4e-13d5051a6dbf tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:50.046860 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-faf65081-c397-4959-9e4e-13d5051a6dbf tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:50.047685 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-faf65081-c397-4959-9e4e-13d5051a6dbf tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:50.048266 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-faf65081-c397-4959-9e4e-13d5051a6dbf tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:50.087457 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-8bcbe543-eb5b-493c-a3b6-2cfca3a2abf9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:50.088702 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-8bcbe543-eb5b-493c-a3b6-2cfca3a2abf9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:50.097746 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8bcbe543-eb5b-493c-a3b6-2cfca3a2abf9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:50.098596 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8bcbe543-eb5b-493c-a3b6-2cfca3a2abf9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:50.099669 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8bcbe543-eb5b-493c-a3b6-2cfca3a2abf9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:50.100483 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8bcbe543-eb5b-493c-a3b6-2cfca3a2abf9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:50.222830 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-faf65081-c397-4959-9e4e-13d5051a6dbf tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:50.230488 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-faf65081-c397-4959-9e4e-13d5051a6dbf tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412" status: 200 len: 1318 microversion: 2.1 time: 0.195520 Nov 16 00:33:50.231094 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 361/715] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:50 2021] GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:50.252263 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-8bcbe543-eb5b-493c-a3b6-2cfca3a2abf9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:50.263680 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-8bcbe543-eb5b-493c-a3b6-2cfca3a2abf9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:50.265213 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-8bcbe543-eb5b-493c-a3b6-2cfca3a2abf9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:50.266950 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-8bcbe543-eb5b-493c-a3b6-2cfca3a2abf9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1407 microversion: 2.20 time: 0.185994 Nov 16 00:33:50.276602 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 355/716] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:33:50 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:33:50.789257 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-539a6f35-5dbd-415d-bbb9-c0a7d620f297 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:50.790164 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-539a6f35-5dbd-415d-bbb9-c0a7d620f297 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:50.796072 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-539a6f35-5dbd-415d-bbb9-c0a7d620f297 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:50.796558 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-539a6f35-5dbd-415d-bbb9-c0a7d620f297 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:50.797968 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-539a6f35-5dbd-415d-bbb9-c0a7d620f297 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:50.798403 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-539a6f35-5dbd-415d-bbb9-c0a7d620f297 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:50.862284 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-539a6f35-5dbd-415d-bbb9-c0a7d620f297 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 14 microversion: 2.1 time: 0.076800 Nov 16 00:33:50.862892 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 362/717] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:33:50 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:33:51.247069 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-94272806-bbf2-49f1-ac31-8c5e12572611 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:51.247681 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-94272806-bbf2-49f1-ac31-8c5e12572611 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: 746c2aa8-ae92-4f51-8664-f9e4a7be7412] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:51.254001 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-94272806-bbf2-49f1-ac31-8c5e12572611 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:51.254429 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-94272806-bbf2-49f1-ac31-8c5e12572611 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:51.255239 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-94272806-bbf2-49f1-ac31-8c5e12572611 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:51.255637 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-94272806-bbf2-49f1-ac31-8c5e12572611 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:51.286458 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f0909109-bd1d-485a-a80d-f7359e297828 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:51.287630 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f0909109-bd1d-485a-a80d-f7359e297828 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:51.294889 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f0909109-bd1d-485a-a80d-f7359e297828 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:51.295482 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f0909109-bd1d-485a-a80d-f7359e297828 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:51.296380 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f0909109-bd1d-485a-a80d-f7359e297828 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:51.297562 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f0909109-bd1d-485a-a80d-f7359e297828 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:51.385969 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-94272806-bbf2-49f1-ac31-8c5e12572611 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:51.393198 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-94272806-bbf2-49f1-ac31-8c5e12572611 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412" status: 200 len: 1318 microversion: 2.1 time: 0.149925 Nov 16 00:33:51.393765 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 356/718] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:51 2021] GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:51.430020 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f0909109-bd1d-485a-a80d-f7359e297828 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:51.438210 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f0909109-bd1d-485a-a80d-f7359e297828 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:51.439732 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f0909109-bd1d-485a-a80d-f7359e297828 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:51.440873 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f0909109-bd1d-485a-a80d-f7359e297828 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1598 microversion: 2.20 time: 0.159881 Nov 16 00:33:51.441428 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 363/719] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:33:51 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:33:51.459944 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-853e2f17-c2db-4e09-8887-f6069e5ccae4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:51.460789 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-853e2f17-c2db-4e09-8887-f6069e5ccae4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:51.470558 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-853e2f17-c2db-4e09-8887-f6069e5ccae4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:51.471004 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-853e2f17-c2db-4e09-8887-f6069e5ccae4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:51.471813 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-853e2f17-c2db-4e09-8887-f6069e5ccae4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:51.472241 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-853e2f17-c2db-4e09-8887-f6069e5ccae4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:51.559543 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-853e2f17-c2db-4e09-8887-f6069e5ccae4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103566 Nov 16 00:33:51.560126 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 357/720] 10.222.0.31 () {60 vars in 1315 bytes} [Tue Nov 16 00:33:51 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:33:51.874245 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c54166e7-44d8-4837-b0be-55422689fc0a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:51.875576 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c54166e7-44d8-4837-b0be-55422689fc0a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:51.882814 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c54166e7-44d8-4837-b0be-55422689fc0a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:51.883395 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c54166e7-44d8-4837-b0be-55422689fc0a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:51.884295 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c54166e7-44d8-4837-b0be-55422689fc0a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:51.884850 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c54166e7-44d8-4837-b0be-55422689fc0a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:51.954206 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c54166e7-44d8-4837-b0be-55422689fc0a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 14 microversion: 2.1 time: 0.083942 Nov 16 00:33:51.955033 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 364/721] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:33:51 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:33:52.409983 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-cb2038ea-13e3-4133-9319-75e8dd0991d8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:52.414373 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-cb2038ea-13e3-4133-9319-75e8dd0991d8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: 746c2aa8-ae92-4f51-8664-f9e4a7be7412] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:52.416966 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cb2038ea-13e3-4133-9319-75e8dd0991d8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:52.417412 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cb2038ea-13e3-4133-9319-75e8dd0991d8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:52.418191 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cb2038ea-13e3-4133-9319-75e8dd0991d8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:52.418619 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cb2038ea-13e3-4133-9319-75e8dd0991d8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:52.581930 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8db50e57-d0d1-4985-a502-538b332c9ff0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:52.583767 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8db50e57-d0d1-4985-a502-538b332c9ff0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:52.590534 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8db50e57-d0d1-4985-a502-538b332c9ff0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:52.591142 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8db50e57-d0d1-4985-a502-538b332c9ff0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:52.592149 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8db50e57-d0d1-4985-a502-538b332c9ff0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:52.592559 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8db50e57-d0d1-4985-a502-538b332c9ff0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:52.595773 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-cb2038ea-13e3-4133-9319-75e8dd0991d8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:52.603376 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-cb2038ea-13e3-4133-9319-75e8dd0991d8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412" status: 200 len: 1318 microversion: 2.1 time: 0.197208 Nov 16 00:33:52.603946 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 358/722] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:52 2021] GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:52.610440 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-3c330821-6a47-4e78-b7f2-d60d302f855e req-56f7b7f8-c903-4f9e-9503-d843790553d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cabac73-4f43-4f58-941d-fcde21d2fdf2", "tag": "24c138f4-ee49-4e30-8553-2bc8c5029b8d"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:52.613032 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:33:52.613032 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:33:52.620384 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-3c330821-6a47-4e78-b7f2-d60d302f855e req-56f7b7f8-c903-4f9e-9503-d843790553d1 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:52.621091 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-3c330821-6a47-4e78-b7f2-d60d302f855e req-56f7b7f8-c903-4f9e-9503-d843790553d1 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:52.633647 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-3c330821-6a47-4e78-b7f2-d60d302f855e req-56f7b7f8-c903-4f9e-9503-d843790553d1 service nova] Creating event network-changed:24c138f4-ee49-4e30-8553-2bc8c5029b8d for instance 5cabac73-4f43-4f58-941d-fcde21d2fdf2 on hv-cinder-81115 Nov 16 00:33:52.638644 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-3c330821-6a47-4e78-b7f2-d60d302f855e req-56f7b7f8-c903-4f9e-9503-d843790553d1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033379 Nov 16 00:33:52.640725 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 359/723] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:33:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:33:52.661468 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8db50e57-d0d1-4985-a502-538b332c9ff0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 14 microversion: 2.20 time: 0.084113 Nov 16 00:33:52.668016 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 365/724] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:33:52 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:52.965652 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0ad0350f-1f1d-4004-b340-591fa9f8900d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:52.966408 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0ad0350f-1f1d-4004-b340-591fa9f8900d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:52.972635 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0ad0350f-1f1d-4004-b340-591fa9f8900d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:52.973314 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0ad0350f-1f1d-4004-b340-591fa9f8900d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:52.974290 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0ad0350f-1f1d-4004-b340-591fa9f8900d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:52.974866 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0ad0350f-1f1d-4004-b340-591fa9f8900d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:53.044167 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0ad0350f-1f1d-4004-b340-591fa9f8900d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 14 microversion: 2.1 time: 0.082308 Nov 16 00:33:53.044838 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 360/725] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:33:52 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:33:53.537462 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-6d5aa26e-188e-45e6-b434-c76bbc16e555 req-82a67af9-ac18-471d-b4c1-6ebd6e853c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "746c2aa8-ae92-4f51-8664-f9e4a7be7412", "name": "network-vif-plugged", "status": "completed", "tag": "0c36d8f3-6603-4623-848c-4d093b88f363"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:53.538969 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:33:53.538969 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:33:53.546679 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-6d5aa26e-188e-45e6-b434-c76bbc16e555 req-82a67af9-ac18-471d-b4c1-6ebd6e853c9b service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:53.547837 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-6d5aa26e-188e-45e6-b434-c76bbc16e555 req-82a67af9-ac18-471d-b4c1-6ebd6e853c9b service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:53.559247 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-6d5aa26e-188e-45e6-b434-c76bbc16e555 req-82a67af9-ac18-471d-b4c1-6ebd6e853c9b service nova] Creating event network-vif-plugged:0c36d8f3-6603-4623-848c-4d093b88f363 for instance 746c2aa8-ae92-4f51-8664-f9e4a7be7412 on hv-cinder-81115 Nov 16 00:33:53.564737 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-6d5aa26e-188e-45e6-b434-c76bbc16e555 req-82a67af9-ac18-471d-b4c1-6ebd6e853c9b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033200 Nov 16 00:33:53.565551 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 366/726] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:33:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:33:53.621406 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-1070e54f-2346-4196-ad1a-7efca7cd6de5 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:53.622136 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-1070e54f-2346-4196-ad1a-7efca7cd6de5 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: 746c2aa8-ae92-4f51-8664-f9e4a7be7412] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:53.630046 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1070e54f-2346-4196-ad1a-7efca7cd6de5 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:53.630665 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1070e54f-2346-4196-ad1a-7efca7cd6de5 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:53.631805 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1070e54f-2346-4196-ad1a-7efca7cd6de5 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:53.632239 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1070e54f-2346-4196-ad1a-7efca7cd6de5 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:53.675970 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-7c01b55c-c93f-40fe-98dd-1b883c771779 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:53.678090 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-7c01b55c-c93f-40fe-98dd-1b883c771779 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:53.686658 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7c01b55c-c93f-40fe-98dd-1b883c771779 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:53.691674 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7c01b55c-c93f-40fe-98dd-1b883c771779 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:53.692720 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7c01b55c-c93f-40fe-98dd-1b883c771779 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:53.693755 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7c01b55c-c93f-40fe-98dd-1b883c771779 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:53.781206 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-7c01b55c-c93f-40fe-98dd-1b883c771779 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 14 microversion: 2.20 time: 0.109261 Nov 16 00:33:53.782231 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 367/727] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:33:53 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:53.795333 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-1070e54f-2346-4196-ad1a-7efca7cd6de5 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:53.807582 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-1070e54f-2346-4196-ad1a-7efca7cd6de5 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412" status: 200 len: 1318 microversion: 2.1 time: 0.186826 Nov 16 00:33:53.808797 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 361/728] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:53 2021] GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:54.063331 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-6f749792-f6d4-4f58-b6bb-d30336badc9f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:54.064348 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-6f749792-f6d4-4f58-b6bb-d30336badc9f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:54.071234 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6f749792-f6d4-4f58-b6bb-d30336badc9f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:54.071926 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6f749792-f6d4-4f58-b6bb-d30336badc9f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:54.072913 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6f749792-f6d4-4f58-b6bb-d30336badc9f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:54.073522 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6f749792-f6d4-4f58-b6bb-d30336badc9f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:54.145772 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-6f749792-f6d4-4f58-b6bb-d30336badc9f tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 14 microversion: 2.1 time: 0.092226 Nov 16 00:33:54.146600 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 368/729] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:33:54 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:33:54.826448 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-5d8e6a62-6b82-4e44-925f-af38e5f09dfc tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:54.827169 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-5d8e6a62-6b82-4e44-925f-af38e5f09dfc tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: 746c2aa8-ae92-4f51-8664-f9e4a7be7412] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:54.834583 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5d8e6a62-6b82-4e44-925f-af38e5f09dfc tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:54.835030 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5d8e6a62-6b82-4e44-925f-af38e5f09dfc tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:54.835832 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5d8e6a62-6b82-4e44-925f-af38e5f09dfc tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:54.836266 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5d8e6a62-6b82-4e44-925f-af38e5f09dfc tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:54.850977 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-82feb21f-d880-43f3-af05-329bfc7924f9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:54.851973 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-82feb21f-d880-43f3-af05-329bfc7924f9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:54.857744 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-82feb21f-d880-43f3-af05-329bfc7924f9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:54.858189 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-82feb21f-d880-43f3-af05-329bfc7924f9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:54.858981 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-82feb21f-d880-43f3-af05-329bfc7924f9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:54.860341 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-82feb21f-d880-43f3-af05-329bfc7924f9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:54.942632 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-82feb21f-d880-43f3-af05-329bfc7924f9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 14 microversion: 2.20 time: 0.154160 Nov 16 00:33:54.943319 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 362/730] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:33:54 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:54.963612 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-5d8e6a62-6b82-4e44-925f-af38e5f09dfc tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:54.971270 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-5d8e6a62-6b82-4e44-925f-af38e5f09dfc tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412" status: 200 len: 1318 microversion: 2.1 time: 0.149132 Nov 16 00:33:54.971825 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 369/731] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:54 2021] GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:55.157894 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-ddd82696-5308-462b-8119-f483008bdb25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:55.158894 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-ddd82696-5308-462b-8119-f483008bdb25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:55.165852 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ddd82696-5308-462b-8119-f483008bdb25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:55.166299 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ddd82696-5308-462b-8119-f483008bdb25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:55.167132 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ddd82696-5308-462b-8119-f483008bdb25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:55.167568 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ddd82696-5308-462b-8119-f483008bdb25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:55.248066 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-ddd82696-5308-462b-8119-f483008bdb25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 14 microversion: 2.1 time: 0.094846 Nov 16 00:33:55.248706 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 363/732] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:33:55 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:33:55.954643 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-0219a331-5574-40bf-bf6f-51ce505e3938 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:55.955596 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-0219a331-5574-40bf-bf6f-51ce505e3938 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:55.962005 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0219a331-5574-40bf-bf6f-51ce505e3938 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:55.962445 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0219a331-5574-40bf-bf6f-51ce505e3938 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:55.963249 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0219a331-5574-40bf-bf6f-51ce505e3938 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:55.963679 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0219a331-5574-40bf-bf6f-51ce505e3938 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:55.989168 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-ddd896f8-6ac2-4965-bb37-ae3a9fc8e96a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:33:55.989865 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-ddd896f8-6ac2-4965-bb37-ae3a9fc8e96a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: 746c2aa8-ae92-4f51-8664-f9e4a7be7412] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:56.002651 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ddd896f8-6ac2-4965-bb37-ae3a9fc8e96a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:56.003132 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ddd896f8-6ac2-4965-bb37-ae3a9fc8e96a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:56.003913 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ddd896f8-6ac2-4965-bb37-ae3a9fc8e96a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:56.004341 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ddd896f8-6ac2-4965-bb37-ae3a9fc8e96a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:56.024876 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-0219a331-5574-40bf-bf6f-51ce505e3938 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 14 microversion: 2.20 time: 0.074613 Nov 16 00:33:56.028133 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 370/733] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:33:55 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:56.130031 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-ddd896f8-6ac2-4965-bb37-ae3a9fc8e96a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:33:56.137782 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-ddd896f8-6ac2-4965-bb37-ae3a9fc8e96a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412" status: 200 len: 1507 microversion: 2.1 time: 0.153368 Nov 16 00:33:56.138365 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 364/734] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:33:55 2021] GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:33:56.155429 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-3fd64c7e-ff37-443d-8acd-c96d52360122 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da6cc236-5d03-44cc-8181-9958cfb80a8d", "device": "/dev/sdb"}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:56.157218 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-3fd64c7e-ff37-443d-8acd-c96d52360122 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: 746c2aa8-ae92-4f51-8664-f9e4a7be7412] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:56.164353 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3fd64c7e-ff37-443d-8acd-c96d52360122 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:56.164804 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3fd64c7e-ff37-443d-8acd-c96d52360122 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:56.165582 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3fd64c7e-ff37-443d-8acd-c96d52360122 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:56.166011 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3fd64c7e-ff37-443d-8acd-c96d52360122 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:56.259173 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a22453d0-51c3-451e-80d8-741b3970d008 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:56.260095 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a22453d0-51c3-451e-80d8-741b3970d008 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:56.266230 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a22453d0-51c3-451e-80d8-741b3970d008 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:56.266671 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a22453d0-51c3-451e-80d8-741b3970d008 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:56.267488 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a22453d0-51c3-451e-80d8-741b3970d008 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:56.267908 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a22453d0-51c3-451e-80d8-741b3970d008 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:56.336858 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a22453d0-51c3-451e-80d8-741b3970d008 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 14 microversion: 2.1 time: 0.081251 Nov 16 00:33:56.337582 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 365/735] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:33:56 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 16 00:33:56.416974 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-3fd64c7e-ff37-443d-8acd-c96d52360122 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "POST /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265571 Nov 16 00:33:56.417783 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 371/736] 10.222.0.31 () {60 vars in 1322 bytes} [Tue Nov 16 00:33:56 2021] POST /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:33:57.037494 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-122b1a24-55e0-48c4-b8d1-cd2dc86f6ccd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:57.038409 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-122b1a24-55e0-48c4-b8d1-cd2dc86f6ccd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:57.045123 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-122b1a24-55e0-48c4-b8d1-cd2dc86f6ccd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:57.045570 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-122b1a24-55e0-48c4-b8d1-cd2dc86f6ccd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:57.046449 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-122b1a24-55e0-48c4-b8d1-cd2dc86f6ccd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:57.047033 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-122b1a24-55e0-48c4-b8d1-cd2dc86f6ccd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:57.113422 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-122b1a24-55e0-48c4-b8d1-cd2dc86f6ccd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 14 microversion: 2.20 time: 0.080254 Nov 16 00:33:57.114046 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 366/737] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:33:57 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:57.348812 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-9a151096-3de0-41c5-a947-1a102d3c53d4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:57.349855 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-9a151096-3de0-41c5-a947-1a102d3c53d4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:57.356731 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9a151096-3de0-41c5-a947-1a102d3c53d4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:57.357170 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9a151096-3de0-41c5-a947-1a102d3c53d4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:57.357933 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9a151096-3de0-41c5-a947-1a102d3c53d4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:57.358361 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9a151096-3de0-41c5-a947-1a102d3c53d4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:57.438527 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-9a151096-3de0-41c5-a947-1a102d3c53d4 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 14 microversion: 2.1 time: 0.093207 Nov 16 00:33:57.439176 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 372/738] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:33:57 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:33:58.125107 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-39b1ade9-6163-43a8-aa34-7c508cbde304 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:58.126387 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-39b1ade9-6163-43a8-aa34-7c508cbde304 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:58.132937 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-39b1ade9-6163-43a8-aa34-7c508cbde304 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:58.133374 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-39b1ade9-6163-43a8-aa34-7c508cbde304 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:58.134138 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-39b1ade9-6163-43a8-aa34-7c508cbde304 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:58.134563 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-39b1ade9-6163-43a8-aa34-7c508cbde304 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:58.196327 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-39b1ade9-6163-43a8-aa34-7c508cbde304 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 14 microversion: 2.20 time: 0.075245 Nov 16 00:33:58.196952 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 367/739] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:33:58 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:58.450892 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-5e4ff39d-14d7-48b4-adc7-176a4e893e9a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:58.451842 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-5e4ff39d-14d7-48b4-adc7-176a4e893e9a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:58.460268 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5e4ff39d-14d7-48b4-adc7-176a4e893e9a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:58.460863 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5e4ff39d-14d7-48b4-adc7-176a4e893e9a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:58.461655 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5e4ff39d-14d7-48b4-adc7-176a4e893e9a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:58.462089 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5e4ff39d-14d7-48b4-adc7-176a4e893e9a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:58.528671 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-5e4ff39d-14d7-48b4-adc7-176a4e893e9a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 14 microversion: 2.1 time: 0.082319 Nov 16 00:33:58.529308 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 373/740] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:33:58 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 16 00:33:59.208710 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-2cc2c154-4749-438f-80d7-2af04f72e367 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:59.209709 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-2cc2c154-4749-438f-80d7-2af04f72e367 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:59.216703 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2cc2c154-4749-438f-80d7-2af04f72e367 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:59.217195 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2cc2c154-4749-438f-80d7-2af04f72e367 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:59.217988 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2cc2c154-4749-438f-80d7-2af04f72e367 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:59.218460 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2cc2c154-4749-438f-80d7-2af04f72e367 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:59.282787 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-2cc2c154-4749-438f-80d7-2af04f72e367 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 14 microversion: 2.20 time: 0.076939 Nov 16 00:33:59.283510 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 368/741] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:33:59 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:33:59.542596 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-41df8a1a-10af-4e17-bc5a-7294b1dac06c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:33:59.543617 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-41df8a1a-10af-4e17-bc5a-7294b1dac06c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:33:59.550236 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-41df8a1a-10af-4e17-bc5a-7294b1dac06c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:59.550677 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-41df8a1a-10af-4e17-bc5a-7294b1dac06c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:59.551485 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-41df8a1a-10af-4e17-bc5a-7294b1dac06c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:33:59.551914 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-41df8a1a-10af-4e17-bc5a-7294b1dac06c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:33:59.614066 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-41df8a1a-10af-4e17-bc5a-7294b1dac06c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 14 microversion: 2.1 time: 0.075264 Nov 16 00:33:59.614847 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 374/742] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:33:59 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:34:00.294967 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e930c595-8442-4fe1-a761-cf02acb03bbc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:00.295926 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e930c595-8442-4fe1-a761-cf02acb03bbc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:00.303197 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e930c595-8442-4fe1-a761-cf02acb03bbc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:00.303637 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e930c595-8442-4fe1-a761-cf02acb03bbc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:00.304404 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e930c595-8442-4fe1-a761-cf02acb03bbc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:00.304831 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e930c595-8442-4fe1-a761-cf02acb03bbc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:00.373564 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e930c595-8442-4fe1-a761-cf02acb03bbc tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 14 microversion: 2.20 time: 0.083020 Nov 16 00:34:00.374416 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 369/743] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:00 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:34:00.625696 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1fb8eeed-1e30-4082-8c1a-3892bb51c4d3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:00.626670 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1fb8eeed-1e30-4082-8c1a-3892bb51c4d3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:00.634029 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1fb8eeed-1e30-4082-8c1a-3892bb51c4d3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:00.634203 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1fb8eeed-1e30-4082-8c1a-3892bb51c4d3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:00.634941 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1fb8eeed-1e30-4082-8c1a-3892bb51c4d3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:00.635423 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1fb8eeed-1e30-4082-8c1a-3892bb51c4d3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:00.706727 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-1fb8eeed-1e30-4082-8c1a-3892bb51c4d3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 14 microversion: 2.1 time: 0.085016 Nov 16 00:34:00.710083 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 375/744] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:00 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:34:01.385769 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-1b24cfab-97a8-4da0-9c64-6e0d944714b3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:01.386780 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-1b24cfab-97a8-4da0-9c64-6e0d944714b3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:01.394459 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1b24cfab-97a8-4da0-9c64-6e0d944714b3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:01.394950 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1b24cfab-97a8-4da0-9c64-6e0d944714b3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:01.395798 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1b24cfab-97a8-4da0-9c64-6e0d944714b3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:01.396242 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1b24cfab-97a8-4da0-9c64-6e0d944714b3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:01.472234 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-1b24cfab-97a8-4da0-9c64-6e0d944714b3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 14 microversion: 2.20 time: 0.090280 Nov 16 00:34:01.473382 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 370/745] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:01 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:34:01.718492 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-9914ba0e-0a30-4654-9f87-3f99fb11a2e6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:01.720119 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-9914ba0e-0a30-4654-9f87-3f99fb11a2e6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:01.726906 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9914ba0e-0a30-4654-9f87-3f99fb11a2e6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:01.727382 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9914ba0e-0a30-4654-9f87-3f99fb11a2e6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:01.728404 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9914ba0e-0a30-4654-9f87-3f99fb11a2e6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:01.728626 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9914ba0e-0a30-4654-9f87-3f99fb11a2e6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:01.806656 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-9914ba0e-0a30-4654-9f87-3f99fb11a2e6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 14 microversion: 2.1 time: 0.092068 Nov 16 00:34:01.807494 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 376/746] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:01 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:34:02.484883 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-554ad7c1-ea5a-4c13-99f0-cfa14ff2a13b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:02.486113 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-554ad7c1-ea5a-4c13-99f0-cfa14ff2a13b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:02.494676 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-554ad7c1-ea5a-4c13-99f0-cfa14ff2a13b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:02.495144 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-554ad7c1-ea5a-4c13-99f0-cfa14ff2a13b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:02.495920 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-554ad7c1-ea5a-4c13-99f0-cfa14ff2a13b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:02.496458 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-554ad7c1-ea5a-4c13-99f0-cfa14ff2a13b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:02.572207 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-554ad7c1-ea5a-4c13-99f0-cfa14ff2a13b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 14 microversion: 2.20 time: 0.091325 Nov 16 00:34:02.572883 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 371/747] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:02 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:34:02.883210 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-3a307429-deae-4f12-90c6-b65075947379 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:02.884228 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-3a307429-deae-4f12-90c6-b65075947379 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:02.890685 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3a307429-deae-4f12-90c6-b65075947379 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:02.891169 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3a307429-deae-4f12-90c6-b65075947379 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:02.891969 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3a307429-deae-4f12-90c6-b65075947379 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:02.892395 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3a307429-deae-4f12-90c6-b65075947379 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:02.989132 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-3a307429-deae-4f12-90c6-b65075947379 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 6451 microversion: 2.1 time: 0.174242 Nov 16 00:34:02.989750 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 377/748] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:02 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 6451 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:34:03.584604 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d5f9634a-083e-4bed-8520-4f20c0a138f5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:03.585633 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d5f9634a-083e-4bed-8520-4f20c0a138f5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:03.592347 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d5f9634a-083e-4bed-8520-4f20c0a138f5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:03.592794 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d5f9634a-083e-4bed-8520-4f20c0a138f5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:03.593571 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d5f9634a-083e-4bed-8520-4f20c0a138f5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:03.594620 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d5f9634a-083e-4bed-8520-4f20c0a138f5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:03.660222 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d5f9634a-083e-4bed-8520-4f20c0a138f5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 14 microversion: 2.20 time: 0.079556 Nov 16 00:34:03.661181 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 372/749] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:03 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:34:04.002988 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-d3c72276-4f21-47fc-a72e-e4ad9d14e25d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:04.004535 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d3c72276-4f21-47fc-a72e-e4ad9d14e25d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:04.012186 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d3c72276-4f21-47fc-a72e-e4ad9d14e25d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:04.012627 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d3c72276-4f21-47fc-a72e-e4ad9d14e25d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:04.013406 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d3c72276-4f21-47fc-a72e-e4ad9d14e25d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:04.013831 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d3c72276-4f21-47fc-a72e-e4ad9d14e25d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:04.092600 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-d3c72276-4f21-47fc-a72e-e4ad9d14e25d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 13992 microversion: 2.1 time: 0.094872 Nov 16 00:34:04.094261 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 378/750] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:03 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 13992 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:34:04.673113 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-7b398cee-879f-4134-be67-7901c880e000 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:04.674113 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-7b398cee-879f-4134-be67-7901c880e000 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:04.680716 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7b398cee-879f-4134-be67-7901c880e000 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:04.681154 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7b398cee-879f-4134-be67-7901c880e000 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:04.681918 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7b398cee-879f-4134-be67-7901c880e000 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:04.682342 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7b398cee-879f-4134-be67-7901c880e000 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:05.110757 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-14123e71-554e-443c-a103-b0d50f58b4e9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:05.112556 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-14123e71-554e-443c-a103-b0d50f58b4e9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:05.122693 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-14123e71-554e-443c-a103-b0d50f58b4e9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:05.123462 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-14123e71-554e-443c-a103-b0d50f58b4e9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:05.124749 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-14123e71-554e-443c-a103-b0d50f58b4e9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:05.125933 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-14123e71-554e-443c-a103-b0d50f58b4e9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:07.294983 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-7b398cee-879f-4134-be67-7901c880e000 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 14890 microversion: 2.20 time: 2.626712 Nov 16 00:34:07.295675 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 373/751] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:04 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 14890 bytes in 2629 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:07.310036 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-14123e71-554e-443c-a103-b0d50f58b4e9 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 21519 microversion: 2.1 time: 2.205678 Nov 16 00:34:07.311088 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 379/752] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:05 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 21519 bytes in 2208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:34:08.308133 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-404d1d40-6a55-472f-a692-d19b27dc9f18 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:08.308133 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-404d1d40-6a55-472f-a692-d19b27dc9f18 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:08.316822 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-404d1d40-6a55-472f-a692-d19b27dc9f18 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:08.316822 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-404d1d40-6a55-472f-a692-d19b27dc9f18 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:08.316822 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-404d1d40-6a55-472f-a692-d19b27dc9f18 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:08.316822 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-404d1d40-6a55-472f-a692-d19b27dc9f18 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:08.324888 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ee5c696c-1f3d-4166-b019-c847d2ec6bc8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:08.326091 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ee5c696c-1f3d-4166-b019-c847d2ec6bc8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:08.333225 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ee5c696c-1f3d-4166-b019-c847d2ec6bc8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:08.333761 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ee5c696c-1f3d-4166-b019-c847d2ec6bc8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:08.334546 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ee5c696c-1f3d-4166-b019-c847d2ec6bc8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:08.335019 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ee5c696c-1f3d-4166-b019-c847d2ec6bc8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:08.394241 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-404d1d40-6a55-472f-a692-d19b27dc9f18 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 18155 microversion: 2.20 time: 0.091294 Nov 16 00:34:08.394977 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 374/753] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:08 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 18155 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:34:08.428692 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ee5c696c-1f3d-4166-b019-c847d2ec6bc8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 22978 microversion: 2.1 time: 0.108794 Nov 16 00:34:08.429858 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 380/754] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:08 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 22978 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:34:09.406799 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-9d50b1e7-8225-4023-aef9-0a7f74b58d96 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:09.407847 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-9d50b1e7-8225-4023-aef9-0a7f74b58d96 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:09.414924 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9d50b1e7-8225-4023-aef9-0a7f74b58d96 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:09.415453 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9d50b1e7-8225-4023-aef9-0a7f74b58d96 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:09.416290 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9d50b1e7-8225-4023-aef9-0a7f74b58d96 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:09.416726 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9d50b1e7-8225-4023-aef9-0a7f74b58d96 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:09.442472 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-abf622c2-a0fa-4c2f-a33b-c853dcdabd83 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:09.443512 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-abf622c2-a0fa-4c2f-a33b-c853dcdabd83 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:09.450137 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-abf622c2-a0fa-4c2f-a33b-c853dcdabd83 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:09.450585 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-abf622c2-a0fa-4c2f-a33b-c853dcdabd83 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:09.451402 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-abf622c2-a0fa-4c2f-a33b-c853dcdabd83 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:09.451835 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-abf622c2-a0fa-4c2f-a33b-c853dcdabd83 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:11.374830 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-9d50b1e7-8225-4023-aef9-0a7f74b58d96 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 21834 microversion: 2.20 time: 1.971833 Nov 16 00:34:11.375765 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 375/755] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:09 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 21834 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:34:11.407095 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-abf622c2-a0fa-4c2f-a33b-c853dcdabd83 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 25706 microversion: 2.1 time: 1.969630 Nov 16 00:34:11.407993 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 381/756] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:09 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 25706 bytes in 1972 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:34:12.389862 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-06863e9c-8042-4562-bd29-170d90fd974f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:12.390891 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-06863e9c-8042-4562-bd29-170d90fd974f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:12.398111 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-06863e9c-8042-4562-bd29-170d90fd974f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:12.398556 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-06863e9c-8042-4562-bd29-170d90fd974f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:12.399483 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-06863e9c-8042-4562-bd29-170d90fd974f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:12.399900 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-06863e9c-8042-4562-bd29-170d90fd974f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:12.420321 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-db8e50be-a5d9-4814-8176-859a321a31f2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:12.421343 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-db8e50be-a5d9-4814-8176-859a321a31f2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:12.428659 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-db8e50be-a5d9-4814-8176-859a321a31f2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:12.429189 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-db8e50be-a5d9-4814-8176-859a321a31f2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:12.429913 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-db8e50be-a5d9-4814-8176-859a321a31f2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:12.430353 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-db8e50be-a5d9-4814-8176-859a321a31f2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:12.479106 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-06863e9c-8042-4562-bd29-170d90fd974f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 23132 microversion: 2.20 time: 0.093158 Nov 16 00:34:12.482175 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 376/757] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:12 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 23132 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:34:12.533514 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-db8e50be-a5d9-4814-8176-859a321a31f2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 26683 microversion: 2.1 time: 0.117412 Nov 16 00:34:12.534218 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 382/758] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:12 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 26683 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:34:13.492982 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-5fbebd7c-5870-47ee-8544-f16fdb216eba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:13.494004 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-5fbebd7c-5870-47ee-8544-f16fdb216eba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:13.500741 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5fbebd7c-5870-47ee-8544-f16fdb216eba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:13.501113 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5fbebd7c-5870-47ee-8544-f16fdb216eba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:13.501888 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5fbebd7c-5870-47ee-8544-f16fdb216eba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:13.502319 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5fbebd7c-5870-47ee-8544-f16fdb216eba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:13.546287 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-bc48aecb-bf46-4fb0-b426-948ec69955b3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:13.547311 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-bc48aecb-bf46-4fb0-b426-948ec69955b3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:13.553716 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bc48aecb-bf46-4fb0-b426-948ec69955b3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:13.554181 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bc48aecb-bf46-4fb0-b426-948ec69955b3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:13.554941 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bc48aecb-bf46-4fb0-b426-948ec69955b3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:13.555386 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bc48aecb-bf46-4fb0-b426-948ec69955b3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:13.580084 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-5fbebd7c-5870-47ee-8544-f16fdb216eba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 24108 microversion: 2.20 time: 0.091034 Nov 16 00:34:13.581899 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 377/759] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:13 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 24108 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:13.656289 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-bc48aecb-bf46-4fb0-b426-948ec69955b3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 27372 microversion: 2.1 time: 0.113784 Nov 16 00:34:13.660432 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 383/760] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:13 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 27372 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:34:14.593765 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-72c789aa-2798-4fb3-bc14-b226cb85478e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:14.594972 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-72c789aa-2798-4fb3-bc14-b226cb85478e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:14.603253 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-72c789aa-2798-4fb3-bc14-b226cb85478e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:14.603695 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-72c789aa-2798-4fb3-bc14-b226cb85478e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:14.604489 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-72c789aa-2798-4fb3-bc14-b226cb85478e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:14.604920 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-72c789aa-2798-4fb3-bc14-b226cb85478e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:14.668821 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-0f79ac2f-0c4e-4168-9d82-fcea536282a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:14.669898 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-0f79ac2f-0c4e-4168-9d82-fcea536282a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:14.676753 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0f79ac2f-0c4e-4168-9d82-fcea536282a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:14.677186 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0f79ac2f-0c4e-4168-9d82-fcea536282a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:14.677959 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0f79ac2f-0c4e-4168-9d82-fcea536282a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:14.678394 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0f79ac2f-0c4e-4168-9d82-fcea536282a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:14.686558 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-72c789aa-2798-4fb3-bc14-b226cb85478e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 25352 microversion: 2.20 time: 0.096834 Nov 16 00:34:14.688298 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 378/761] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:14 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 25352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:14.767732 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-0f79ac2f-0c4e-4168-9d82-fcea536282a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 27793 microversion: 2.1 time: 0.102428 Nov 16 00:34:14.773247 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 384/762] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:14 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 27793 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:34:15.701007 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d683bafe-15be-444e-afc4-78a37b968569 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:15.702014 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d683bafe-15be-444e-afc4-78a37b968569 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:15.710387 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d683bafe-15be-444e-afc4-78a37b968569 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:15.710864 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d683bafe-15be-444e-afc4-78a37b968569 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:15.711687 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d683bafe-15be-444e-afc4-78a37b968569 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:15.712152 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d683bafe-15be-444e-afc4-78a37b968569 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:15.781429 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-737570e7-2cc4-4de0-a107-a0abb5069ea6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:15.782587 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-737570e7-2cc4-4de0-a107-a0abb5069ea6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:15.791492 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-737570e7-2cc4-4de0-a107-a0abb5069ea6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:15.792203 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-737570e7-2cc4-4de0-a107-a0abb5069ea6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:15.792697 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d683bafe-15be-444e-afc4-78a37b968569 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 26399 microversion: 2.20 time: 0.095288 Nov 16 00:34:15.797061 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 379/763] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:15 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 26399 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:15.797280 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-737570e7-2cc4-4de0-a107-a0abb5069ea6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:15.797280 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-737570e7-2cc4-4de0-a107-a0abb5069ea6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:15.824740 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-c6432e14-7595-42ad-b929-168e30dc7774 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:15.825336 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-c6432e14-7595-42ad-b929-168e30dc7774 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: 746c2aa8-ae92-4f51-8664-f9e4a7be7412] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:15.834010 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c6432e14-7595-42ad-b929-168e30dc7774 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:15.834448 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c6432e14-7595-42ad-b929-168e30dc7774 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:15.835273 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c6432e14-7595-42ad-b929-168e30dc7774 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:15.835727 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c6432e14-7595-42ad-b929-168e30dc7774 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:15.881276 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-737570e7-2cc4-4de0-a107-a0abb5069ea6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 28101 microversion: 2.1 time: 0.103638 Nov 16 00:34:15.881930 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 385/764] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:15 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 28101 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:34:15.979268 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.objects.instance [None req-c6432e14-7595-42ad-b929-168e30dc7774 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lazy-loading 'services' on Instance uuid 746c2aa8-ae92-4f51-8664-f9e4a7be7412 {{(pid=122544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:34:16.119634 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-c6432e14-7595-42ad-b929-168e30dc7774 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "DELETE /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412/os-volume_attachments/da6cc236-5d03-44cc-8181-9958cfb80a8d" status: 202 len: 0 microversion: 2.1 time: 0.298781 Nov 16 00:34:16.120458 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 380/765] 10.222.0.31 () {58 vars in 1415 bytes} [Tue Nov 16 00:34:15 2021] DELETE /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412/os-volume_attachments/da6cc236-5d03-44cc-8181-9958cfb80a8d => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:16.805859 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-cb16d75c-48d9-4e95-ba63-1e9c6be509de tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:16.806848 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-cb16d75c-48d9-4e95-ba63-1e9c6be509de tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:16.813326 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cb16d75c-48d9-4e95-ba63-1e9c6be509de tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:16.813767 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cb16d75c-48d9-4e95-ba63-1e9c6be509de tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:16.814536 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cb16d75c-48d9-4e95-ba63-1e9c6be509de tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:16.815022 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cb16d75c-48d9-4e95-ba63-1e9c6be509de tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:16.896627 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-78af1dc0-2f4a-40cc-8137-87d0bf9df91e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:16.898361 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-78af1dc0-2f4a-40cc-8137-87d0bf9df91e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:16.902055 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-cb16d75c-48d9-4e95-ba63-1e9c6be509de tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 27164 microversion: 2.20 time: 0.100072 Nov 16 00:34:16.906173 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 386/766] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:16 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 27164 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:16.906363 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-78af1dc0-2f4a-40cc-8137-87d0bf9df91e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:16.906363 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-78af1dc0-2f4a-40cc-8137-87d0bf9df91e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:16.906887 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-78af1dc0-2f4a-40cc-8137-87d0bf9df91e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:16.907345 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-78af1dc0-2f4a-40cc-8137-87d0bf9df91e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:17.008759 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-78af1dc0-2f4a-40cc-8137-87d0bf9df91e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 28163 microversion: 2.1 time: 0.116878 Nov 16 00:34:17.009331 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 381/767] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:16 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 28163 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:34:17.265131 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-49fc3f61-1148-48cf-8189-6b3a1851e57a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:17.265668 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-49fc3f61-1148-48cf-8189-6b3a1851e57a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: 746c2aa8-ae92-4f51-8664-f9e4a7be7412] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:17.273423 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-49fc3f61-1148-48cf-8189-6b3a1851e57a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:17.273891 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-49fc3f61-1148-48cf-8189-6b3a1851e57a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:17.274677 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-49fc3f61-1148-48cf-8189-6b3a1851e57a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:17.275142 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-49fc3f61-1148-48cf-8189-6b3a1851e57a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:17.302449 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-49fc3f61-1148-48cf-8189-6b3a1851e57a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: 746c2aa8-ae92-4f51-8664-f9e4a7be7412] Going to try to terminate instance {{(pid=122543) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:34:17.392639 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-49fc3f61-1148-48cf-8189-6b3a1851e57a tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "DELETE /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412" status: 204 len: 0 microversion: 2.1 time: 0.131230 Nov 16 00:34:17.393284 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 387/768] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:34:17 2021] DELETE /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 16 00:34:17.403577 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-134f0df7-ce9b-462e-af98-cf17df72978b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:17.404266 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-134f0df7-ce9b-462e-af98-cf17df72978b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: 746c2aa8-ae92-4f51-8664-f9e4a7be7412] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:17.411126 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-134f0df7-ce9b-462e-af98-cf17df72978b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:17.411585 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-134f0df7-ce9b-462e-af98-cf17df72978b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:17.412360 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-134f0df7-ce9b-462e-af98-cf17df72978b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:17.412782 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-134f0df7-ce9b-462e-af98-cf17df72978b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:17.541806 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-134f0df7-ce9b-462e-af98-cf17df72978b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:17.553933 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-134f0df7-ce9b-462e-af98-cf17df72978b tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412" status: 200 len: 1513 microversion: 2.1 time: 0.154794 Nov 16 00:34:17.554739 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 382/769] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:34:17 2021] GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:34:17.916185 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-3ded6641-7e74-4b56-8c7e-373895293764 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:17.917167 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-3ded6641-7e74-4b56-8c7e-373895293764 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:17.924661 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3ded6641-7e74-4b56-8c7e-373895293764 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:17.926064 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3ded6641-7e74-4b56-8c7e-373895293764 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:17.927003 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3ded6641-7e74-4b56-8c7e-373895293764 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:17.927489 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3ded6641-7e74-4b56-8c7e-373895293764 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:18.014259 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-3ded6641-7e74-4b56-8c7e-373895293764 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 27576 microversion: 2.20 time: 0.103172 Nov 16 00:34:18.015717 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 388/770] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:17 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 27576 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:34:18.021058 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-9bea016c-9d6c-4421-a9c9-5bc365862768 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:18.021995 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-9bea016c-9d6c-4421-a9c9-5bc365862768 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:18.028223 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9bea016c-9d6c-4421-a9c9-5bc365862768 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:18.028674 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9bea016c-9d6c-4421-a9c9-5bc365862768 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:18.029461 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9bea016c-9d6c-4421-a9c9-5bc365862768 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:18.029896 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9bea016c-9d6c-4421-a9c9-5bc365862768 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:18.101030 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-9bea016c-9d6c-4421-a9c9-5bc365862768 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 28163 microversion: 2.1 time: 0.084708 Nov 16 00:34:18.101680 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 383/771] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:18 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 28163 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:34:18.571797 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-2818637a-ff19-4016-aeba-368743ab58fb tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:18.572532 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-2818637a-ff19-4016-aeba-368743ab58fb tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: 746c2aa8-ae92-4f51-8664-f9e4a7be7412] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:18.579259 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2818637a-ff19-4016-aeba-368743ab58fb tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:18.579698 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2818637a-ff19-4016-aeba-368743ab58fb tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:18.580581 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2818637a-ff19-4016-aeba-368743ab58fb tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:18.581645 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2818637a-ff19-4016-aeba-368743ab58fb tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:18.725071 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2818637a-ff19-4016-aeba-368743ab58fb tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:18.733287 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-2818637a-ff19-4016-aeba-368743ab58fb tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412" status: 200 len: 1513 microversion: 2.1 time: 0.165810 Nov 16 00:34:18.733869 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 389/772] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:34:18 2021] GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:34:19.027806 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-4c306c9a-defd-4041-9e0e-ade7e27a7cba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:19.028733 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-4c306c9a-defd-4041-9e0e-ade7e27a7cba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:19.036452 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4c306c9a-defd-4041-9e0e-ade7e27a7cba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:19.036892 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4c306c9a-defd-4041-9e0e-ade7e27a7cba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:19.037673 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4c306c9a-defd-4041-9e0e-ade7e27a7cba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:19.038098 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4c306c9a-defd-4041-9e0e-ade7e27a7cba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:19.115793 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-e91dbbbb-aa86-4515-b988-cc06733daf63 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:19.116774 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-e91dbbbb-aa86-4515-b988-cc06733daf63 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:19.122979 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e91dbbbb-aa86-4515-b988-cc06733daf63 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:19.123452 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e91dbbbb-aa86-4515-b988-cc06733daf63 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:19.124509 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e91dbbbb-aa86-4515-b988-cc06733daf63 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:19.124938 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e91dbbbb-aa86-4515-b988-cc06733daf63 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:19.134565 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-4c306c9a-defd-4041-9e0e-ade7e27a7cba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 27810 microversion: 2.20 time: 0.110194 Nov 16 00:34:19.135905 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 384/773] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:19 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 27810 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:19.200963 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-e91dbbbb-aa86-4515-b988-cc06733daf63 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 28163 microversion: 2.1 time: 0.089248 Nov 16 00:34:19.201619 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 390/774] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:19 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 28163 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:34:19.750802 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-7701d046-3ea2-4d09-88cf-0712f3958893 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:19.751728 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-7701d046-3ea2-4d09-88cf-0712f3958893 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: 746c2aa8-ae92-4f51-8664-f9e4a7be7412] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:19.761071 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7701d046-3ea2-4d09-88cf-0712f3958893 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:19.761860 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7701d046-3ea2-4d09-88cf-0712f3958893 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:19.762677 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7701d046-3ea2-4d09-88cf-0712f3958893 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:19.763140 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7701d046-3ea2-4d09-88cf-0712f3958893 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:19.917553 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-7701d046-3ea2-4d09-88cf-0712f3958893 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4b2e84db43455d843f4b322fae785e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ea54a26354e40baac7af6061517ccf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:19.926129 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-7701d046-3ea2-4d09-88cf-0712f3958893 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412" status: 200 len: 1513 microversion: 2.1 time: 0.179684 Nov 16 00:34:19.926987 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 385/775] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:34:19 2021] GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412 => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:34:20.151496 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-62186f47-599d-426b-9bf5-e1ac8555c5c8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:20.153745 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-62186f47-599d-426b-9bf5-e1ac8555c5c8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:20.163036 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-62186f47-599d-426b-9bf5-e1ac8555c5c8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:20.163525 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-62186f47-599d-426b-9bf5-e1ac8555c5c8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:20.164339 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-62186f47-599d-426b-9bf5-e1ac8555c5c8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:20.165164 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-62186f47-599d-426b-9bf5-e1ac8555c5c8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:20.168775 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-b7d36823-84cb-4382-b054-512e9f31533d req-8368aa0c-6228-42ea-8784-f11480330734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "746c2aa8-ae92-4f51-8664-f9e4a7be7412", "name": "network-vif-deleted", "tag": "0c36d8f3-6603-4623-848c-4d093b88f363"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:20.170862 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:34:20.170862 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:34:20.180790 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-b7d36823-84cb-4382-b054-512e9f31533d req-8368aa0c-6228-42ea-8784-f11480330734 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:20.181448 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-b7d36823-84cb-4382-b054-512e9f31533d req-8368aa0c-6228-42ea-8784-f11480330734 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:20.199387 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-b7d36823-84cb-4382-b054-512e9f31533d req-8368aa0c-6228-42ea-8784-f11480330734 service nova] Creating event network-vif-deleted:0c36d8f3-6603-4623-848c-4d093b88f363 for instance 746c2aa8-ae92-4f51-8664-f9e4a7be7412 on hv-cinder-81115 Nov 16 00:34:20.208102 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-b7d36823-84cb-4382-b054-512e9f31533d req-8368aa0c-6228-42ea-8784-f11480330734 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159019 Nov 16 00:34:20.209869 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 391/776] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:34:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:34:20.218094 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-301b95ab-370f-4076-90fb-8168ac725886 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:20.219244 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-301b95ab-370f-4076-90fb-8168ac725886 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:20.226741 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-301b95ab-370f-4076-90fb-8168ac725886 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:20.227333 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-301b95ab-370f-4076-90fb-8168ac725886 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:20.228106 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-301b95ab-370f-4076-90fb-8168ac725886 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:20.228531 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-301b95ab-370f-4076-90fb-8168ac725886 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:20.269563 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-62186f47-599d-426b-9bf5-e1ac8555c5c8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 28179 microversion: 2.20 time: 0.122113 Nov 16 00:34:20.270837 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 386/777] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:20 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 28179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:20.318537 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-301b95ab-370f-4076-90fb-8168ac725886 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 28453 microversion: 2.1 time: 0.106548 Nov 16 00:34:20.319375 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 392/778] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:20 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 28453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:34:20.946397 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3dc5241e-7a85-4f4a-84b5-d214080a45b8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:20.947245 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3dc5241e-7a85-4f4a-84b5-d214080a45b8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] [instance: 746c2aa8-ae92-4f51-8664-f9e4a7be7412] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:20.955617 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3dc5241e-7a85-4f4a-84b5-d214080a45b8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:20.956545 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3dc5241e-7a85-4f4a-84b5-d214080a45b8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:20.957341 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3dc5241e-7a85-4f4a-84b5-d214080a45b8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:20.957761 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3dc5241e-7a85-4f4a-84b5-d214080a45b8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:20.973833 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-3dc5241e-7a85-4f4a-84b5-d214080a45b8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] HTTP exception thrown: Instance 746c2aa8-ae92-4f51-8664-f9e4a7be7412 could not be found. Nov 16 00:34:20.974435 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3dc5241e-7a85-4f4a-84b5-d214080a45b8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] Returning 404 to user: Instance 746c2aa8-ae92-4f51-8664-f9e4a7be7412 could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:34:20.975316 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-3dc5241e-7a85-4f4a-84b5-d214080a45b8 tempest-VolumesSnapshotTestJSON-1323230669 tempest-VolumesSnapshotTestJSON-1323230669-project] 10.222.0.31 "GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412" status: 404 len: 111 microversion: 2.1 time: 0.033899 Nov 16 00:34:20.975888 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 387/779] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:34:20 2021] GET /compute/v2.1/servers/746c2aa8-ae92-4f51-8664-f9e4a7be7412 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 00:34:21.285857 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-360f5f5a-17a7-44be-8f25-5cbb0e616b47 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:21.287953 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-360f5f5a-17a7-44be-8f25-5cbb0e616b47 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:21.298820 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-360f5f5a-17a7-44be-8f25-5cbb0e616b47 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:21.300150 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-360f5f5a-17a7-44be-8f25-5cbb0e616b47 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:21.301289 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-360f5f5a-17a7-44be-8f25-5cbb0e616b47 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:21.301871 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-360f5f5a-17a7-44be-8f25-5cbb0e616b47 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:21.341707 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-89010f0f-1e7e-483f-96c0-62644847ad9e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:21.343631 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-89010f0f-1e7e-483f-96c0-62644847ad9e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:21.353499 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-89010f0f-1e7e-483f-96c0-62644847ad9e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:21.353941 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-89010f0f-1e7e-483f-96c0-62644847ad9e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:21.354749 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-89010f0f-1e7e-483f-96c0-62644847ad9e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:21.355223 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-89010f0f-1e7e-483f-96c0-62644847ad9e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:21.393197 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-360f5f5a-17a7-44be-8f25-5cbb0e616b47 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 28179 microversion: 2.20 time: 0.114197 Nov 16 00:34:21.394888 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 393/780] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:21 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 28179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:34:21.450051 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-89010f0f-1e7e-483f-96c0-62644847ad9e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 28621 microversion: 2.1 time: 0.119498 Nov 16 00:34:21.450698 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 388/781] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:21 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 28621 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:34:21.892401 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-7644a2ff-77ae-4ba0-b4d3-0a1ba7f48176 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1536369284"}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:21.893030 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-7644a2ff-77ae-4ba0-b4d3-0a1ba7f48176 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:21.901258 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7644a2ff-77ae-4ba0-b4d3-0a1ba7f48176 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:21.902161 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7644a2ff-77ae-4ba0-b4d3-0a1ba7f48176 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:21.902650 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7644a2ff-77ae-4ba0-b4d3-0a1ba7f48176 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:21.903173 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7644a2ff-77ae-4ba0-b4d3-0a1ba7f48176 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:22.058083 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.network.security_group_api [None req-7644a2ff-77ae-4ba0-b4d3-0a1ba7f48176 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Removing security group ee0dc591-4647-4bb0-b605-bcaf54f2684a from port 766ca728-c4c6-4a74-b3aa-0075802cbf56 Nov 16 00:34:22.408417 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3bb92701-d3e7-4ee6-a107-445236ea1966 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:22.410033 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3bb92701-d3e7-4ee6-a107-445236ea1966 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:22.417656 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3bb92701-d3e7-4ee6-a107-445236ea1966 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:22.418586 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3bb92701-d3e7-4ee6-a107-445236ea1966 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:22.419422 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3bb92701-d3e7-4ee6-a107-445236ea1966 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:22.419871 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3bb92701-d3e7-4ee6-a107-445236ea1966 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:22.517310 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-3bb92701-d3e7-4ee6-a107-445236ea1966 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 28464 microversion: 2.20 time: 0.111944 Nov 16 00:34:22.518754 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-7644a2ff-77ae-4ba0-b4d3-0a1ba7f48176 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "POST /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81/action" status: 202 len: 0 microversion: 2.1 time: 0.630047 Nov 16 00:34:22.521285 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 389/783] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:22 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 28464 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:34:22.521507 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 394/783] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:21 2021] POST /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:22.545928 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-86a8ce15-e23a-481c-8c84-effa63407cc6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:22.547761 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-5ee81191-3ec0-461d-b169-e833e9a67e4a req-0a4733fd-7c82-4718-b951-0d4faeb41b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81", "tag": "766ca728-c4c6-4a74-b3aa-0075802cbf56"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:22.548080 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-86a8ce15-e23a-481c-8c84-effa63407cc6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:22.550064 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:34:22.550064 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:34:22.567779 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-5ee81191-3ec0-461d-b169-e833e9a67e4a req-0a4733fd-7c82-4718-b951-0d4faeb41b30 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:22.568519 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-5ee81191-3ec0-461d-b169-e833e9a67e4a req-0a4733fd-7c82-4718-b951-0d4faeb41b30 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:22.571554 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-86a8ce15-e23a-481c-8c84-effa63407cc6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:22.572353 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-86a8ce15-e23a-481c-8c84-effa63407cc6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:22.574301 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-86a8ce15-e23a-481c-8c84-effa63407cc6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:22.575518 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-86a8ce15-e23a-481c-8c84-effa63407cc6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:22.591524 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-5ee81191-3ec0-461d-b169-e833e9a67e4a req-0a4733fd-7c82-4718-b951-0d4faeb41b30 service nova] Creating event network-changed:766ca728-c4c6-4a74-b3aa-0075802cbf56 for instance 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 on hv-cinder-81115 Nov 16 00:34:22.598800 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-5ee81191-3ec0-461d-b169-e833e9a67e4a req-0a4733fd-7c82-4718-b951-0d4faeb41b30 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056393 Nov 16 00:34:22.600455 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 395/784] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:34:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:34:22.709766 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-86a8ce15-e23a-481c-8c84-effa63407cc6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 28621 microversion: 2.1 time: 0.184657 Nov 16 00:34:22.716485 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 390/785] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:22 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 28621 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:34:23.545230 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-40fd61eb-9d59-436b-baee-4850b7ce39c4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:23.547019 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-40fd61eb-9d59-436b-baee-4850b7ce39c4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:23.557147 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-40fd61eb-9d59-436b-baee-4850b7ce39c4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:23.557585 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-40fd61eb-9d59-436b-baee-4850b7ce39c4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:23.558387 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-40fd61eb-9d59-436b-baee-4850b7ce39c4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:23.558812 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-40fd61eb-9d59-436b-baee-4850b7ce39c4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:23.726272 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-1771cd18-cac0-4b93-89f2-8f98d8f73fe3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:23.727682 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-1771cd18-cac0-4b93-89f2-8f98d8f73fe3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:23.736404 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1771cd18-cac0-4b93-89f2-8f98d8f73fe3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:23.738004 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1771cd18-cac0-4b93-89f2-8f98d8f73fe3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:23.739898 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1771cd18-cac0-4b93-89f2-8f98d8f73fe3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:23.740537 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1771cd18-cac0-4b93-89f2-8f98d8f73fe3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:25.739403 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-40fd61eb-9d59-436b-baee-4850b7ce39c4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 28470 microversion: 2.20 time: 2.203438 Nov 16 00:34:25.741475 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 396/786] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:23 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 28470 bytes in 2207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:25.750318 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f8f1a179-1308-4601-97ab-b550c733f419 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:25.751562 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f8f1a179-1308-4601-97ab-b550c733f419 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:25.760039 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f8f1a179-1308-4601-97ab-b550c733f419 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:25.760637 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f8f1a179-1308-4601-97ab-b550c733f419 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:25.761569 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f8f1a179-1308-4601-97ab-b550c733f419 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:25.762921 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f8f1a179-1308-4601-97ab-b550c733f419 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:25.763691 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-1771cd18-cac0-4b93-89f2-8f98d8f73fe3 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 28621 microversion: 2.1 time: 2.043993 Nov 16 00:34:25.766523 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 391/787] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:23 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 28621 bytes in 2048 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:34:25.840792 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-f80d0540-3b95-45da-975d-63dd6a860be3 req-7678e5da-cdcd-4567-9d25-405512fdf4dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81", "tag": "766ca728-c4c6-4a74-b3aa-0075802cbf56"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:25.842440 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:34:25.842440 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:34:25.851241 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-f80d0540-3b95-45da-975d-63dd6a860be3 req-7678e5da-cdcd-4567-9d25-405512fdf4dd service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:25.851680 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-f80d0540-3b95-45da-975d-63dd6a860be3 req-7678e5da-cdcd-4567-9d25-405512fdf4dd service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:25.876032 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.objects.instance [None req-f8f1a179-1308-4601-97ab-b550c733f419 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lazy-loading 'services' on Instance uuid 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 {{(pid=122543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:34:25.881180 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-f80d0540-3b95-45da-975d-63dd6a860be3 req-7678e5da-cdcd-4567-9d25-405512fdf4dd service nova] Creating event network-changed:766ca728-c4c6-4a74-b3aa-0075802cbf56 for instance 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 on hv-cinder-81115 Nov 16 00:34:25.887309 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-f80d0540-3b95-45da-975d-63dd6a860be3 req-7678e5da-cdcd-4567-9d25-405512fdf4dd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116406 Nov 16 00:34:25.891898 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 392/788] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:34:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:34:25.960684 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f8f1a179-1308-4601-97ab-b550c733f419 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "DELETE /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81/os-volume_attachments/5b3e67b7-837f-425a-beda-fe121a016cdc" status: 202 len: 0 microversion: 2.1 time: 0.217081 Nov 16 00:34:25.961329 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 397/789] 10.222.0.31 () {58 vars in 1415 bytes} [Tue Nov 16 00:34:25 2021] DELETE /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81/os-volume_attachments/5b3e67b7-837f-425a-beda-fe121a016cdc => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:25.973312 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-50e88786-3f61-4ff9-a0d9-ea3e98e5ee39 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:25.974179 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-50e88786-3f61-4ff9-a0d9-ea3e98e5ee39 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:25.985129 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-50e88786-3f61-4ff9-a0d9-ea3e98e5ee39 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:25.985935 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-50e88786-3f61-4ff9-a0d9-ea3e98e5ee39 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:25.987338 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-50e88786-3f61-4ff9-a0d9-ea3e98e5ee39 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:25.988080 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-50e88786-3f61-4ff9-a0d9-ea3e98e5ee39 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:26.052191 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-50e88786-3f61-4ff9-a0d9-ea3e98e5ee39 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082621 Nov 16 00:34:26.053131 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 393/790] 10.222.0.31 () {58 vars in 1301 bytes} [Tue Nov 16 00:34:25 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:34:26.756296 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ea54338f-6ecb-44ad-947a-ee63f7da4997 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:26.759091 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ea54338f-6ecb-44ad-947a-ee63f7da4997 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:26.769820 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ea54338f-6ecb-44ad-947a-ee63f7da4997 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:26.770578 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ea54338f-6ecb-44ad-947a-ee63f7da4997 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:26.772071 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ea54338f-6ecb-44ad-947a-ee63f7da4997 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:26.772884 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ea54338f-6ecb-44ad-947a-ee63f7da4997 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:26.783877 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f953a689-e821-48c9-9ee4-24e6e06eb3c2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:26.786333 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f953a689-e821-48c9-9ee4-24e6e06eb3c2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:26.799493 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f953a689-e821-48c9-9ee4-24e6e06eb3c2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:26.801298 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f953a689-e821-48c9-9ee4-24e6e06eb3c2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:26.803072 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f953a689-e821-48c9-9ee4-24e6e06eb3c2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:26.803780 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f953a689-e821-48c9-9ee4-24e6e06eb3c2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:26.882795 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ea54338f-6ecb-44ad-947a-ee63f7da4997 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 28638 microversion: 2.20 time: 0.132852 Nov 16 00:34:26.883453 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 398/791] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:26 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 28638 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:26.902751 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-f953a689-e821-48c9-9ee4-24e6e06eb3c2 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 28621 microversion: 2.1 time: 0.129413 Nov 16 00:34:26.908548 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 394/792] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:26 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 28621 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:34:27.068403 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-459b9a91-481c-4a8f-9a1d-aa550548aeb9 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:27.070206 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-459b9a91-481c-4a8f-9a1d-aa550548aeb9 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:27.082220 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-459b9a91-481c-4a8f-9a1d-aa550548aeb9 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:27.082936 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-459b9a91-481c-4a8f-9a1d-aa550548aeb9 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:27.084328 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-459b9a91-481c-4a8f-9a1d-aa550548aeb9 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:27.085081 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-459b9a91-481c-4a8f-9a1d-aa550548aeb9 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:27.134253 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-459b9a91-481c-4a8f-9a1d-aa550548aeb9 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071547 Nov 16 00:34:27.134825 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 399/793] 10.222.0.31 () {58 vars in 1301 bytes} [Tue Nov 16 00:34:27 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:34:27.150419 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d7680106-fe3c-4381-bac0-69e93377150e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:27.151382 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d7680106-fe3c-4381-bac0-69e93377150e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:27.162872 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d7680106-fe3c-4381-bac0-69e93377150e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:27.163829 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d7680106-fe3c-4381-bac0-69e93377150e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:27.165085 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d7680106-fe3c-4381-bac0-69e93377150e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:27.166250 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d7680106-fe3c-4381-bac0-69e93377150e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:27.301988 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-d7680106-fe3c-4381-bac0-69e93377150e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] HTTP exception thrown: Instance 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 is not attached to volume 5b3e67b7-837f-425a-beda-fe121a016cdc Nov 16 00:34:27.302582 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d7680106-fe3c-4381-bac0-69e93377150e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Returning 404 to user: Instance 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 is not attached to volume 5b3e67b7-837f-425a-beda-fe121a016cdc {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:34:27.303443 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d7680106-fe3c-4381-bac0-69e93377150e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "DELETE /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81/os-volume_attachments/5b3e67b7-837f-425a-beda-fe121a016cdc" status: 404 len: 154 microversion: 2.1 time: 0.161395 Nov 16 00:34:27.303997 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 395/794] 10.222.0.31 () {58 vars in 1415 bytes} [Tue Nov 16 00:34:27 2021] DELETE /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81/os-volume_attachments/5b3e67b7-837f-425a-beda-fe121a016cdc => generated 154 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 00:34:27.896579 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-15fca884-6eb6-4d4e-a6c4-2c65fbec6b5a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:27.897966 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-15fca884-6eb6-4d4e-a6c4-2c65fbec6b5a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:27.905484 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-15fca884-6eb6-4d4e-a6c4-2c65fbec6b5a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:27.906262 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-15fca884-6eb6-4d4e-a6c4-2c65fbec6b5a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:27.907577 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-15fca884-6eb6-4d4e-a6c4-2c65fbec6b5a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:27.908174 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-15fca884-6eb6-4d4e-a6c4-2c65fbec6b5a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:27.920433 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-189b5810-9ddc-4971-984e-76d6b736f49e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:27.921918 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-189b5810-9ddc-4971-984e-76d6b736f49e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:27.936673 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-189b5810-9ddc-4971-984e-76d6b736f49e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:27.937390 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-189b5810-9ddc-4971-984e-76d6b736f49e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:27.938672 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-189b5810-9ddc-4971-984e-76d6b736f49e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:27.939759 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-189b5810-9ddc-4971-984e-76d6b736f49e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:28.007771 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-15fca884-6eb6-4d4e-a6c4-2c65fbec6b5a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 28638 microversion: 2.20 time: 0.116917 Nov 16 00:34:28.009448 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 400/795] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:27 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 28638 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:34:28.013065 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-189b5810-9ddc-4971-984e-76d6b736f49e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 28621 microversion: 2.1 time: 0.098433 Nov 16 00:34:28.013781 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 396/796] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:27 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 28621 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:34:28.479782 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-b4960a02-4eed-4c2e-a367-34c05fdc94df tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:28.480383 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b4960a02-4eed-4c2e-a367-34c05fdc94df tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:28.489812 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b4960a02-4eed-4c2e-a367-34c05fdc94df tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:28.490289 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b4960a02-4eed-4c2e-a367-34c05fdc94df tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:28.491022 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b4960a02-4eed-4c2e-a367-34c05fdc94df tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:28.491488 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b4960a02-4eed-4c2e-a367-34c05fdc94df tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:28.519552 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b4960a02-4eed-4c2e-a367-34c05fdc94df tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Going to try to terminate instance {{(pid=122543) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:34:28.610224 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-b4960a02-4eed-4c2e-a367-34c05fdc94df tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "DELETE /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 204 len: 0 microversion: 2.1 time: 0.134742 Nov 16 00:34:28.610706 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 401/797] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:34:28 2021] DELETE /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 00:34:28.622011 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-89ed0653-0b0f-4482-a272-32146363902c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:28.622965 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-89ed0653-0b0f-4482-a272-32146363902c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:28.635594 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-89ed0653-0b0f-4482-a272-32146363902c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:28.636259 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-89ed0653-0b0f-4482-a272-32146363902c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:28.637580 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-89ed0653-0b0f-4482-a272-32146363902c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:28.638329 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-89ed0653-0b0f-4482-a272-32146363902c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:28.792722 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-89ed0653-0b0f-4482-a272-32146363902c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:28.802307 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-89ed0653-0b0f-4482-a272-32146363902c tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1555 microversion: 2.1 time: 0.186174 Nov 16 00:34:28.802963 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 397/798] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:34:28 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1555 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:34:29.024038 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-a9b597f4-cc71-4fc0-8acf-116c3e59ad27 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:29.024977 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-a9b597f4-cc71-4fc0-8acf-116c3e59ad27 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:29.026772 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-173764f1-073b-479a-81d0-125d3974a3fa tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:29.027816 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-173764f1-073b-479a-81d0-125d3974a3fa tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:29.031106 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a9b597f4-cc71-4fc0-8acf-116c3e59ad27 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:29.031560 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a9b597f4-cc71-4fc0-8acf-116c3e59ad27 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:29.032338 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a9b597f4-cc71-4fc0-8acf-116c3e59ad27 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:29.032768 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a9b597f4-cc71-4fc0-8acf-116c3e59ad27 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:29.033694 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-173764f1-073b-479a-81d0-125d3974a3fa tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:29.034254 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-173764f1-073b-479a-81d0-125d3974a3fa tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:29.035295 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-173764f1-073b-479a-81d0-125d3974a3fa tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:29.035990 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-173764f1-073b-479a-81d0-125d3974a3fa tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:29.106374 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-173764f1-073b-479a-81d0-125d3974a3fa tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 28621 microversion: 2.1 time: 0.083079 Nov 16 00:34:29.107024 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 398/799] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:29 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 28621 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:34:29.113042 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-a9b597f4-cc71-4fc0-8acf-116c3e59ad27 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 28638 microversion: 2.20 time: 0.092232 Nov 16 00:34:29.114276 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 402/800] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:29 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 28638 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:29.820756 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-39a4904d-668c-4575-a09e-946509d6387e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:29.821462 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-39a4904d-668c-4575-a09e-946509d6387e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:29.828631 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-39a4904d-668c-4575-a09e-946509d6387e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:29.829066 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-39a4904d-668c-4575-a09e-946509d6387e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:29.829852 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-39a4904d-668c-4575-a09e-946509d6387e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:29.830319 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-39a4904d-668c-4575-a09e-946509d6387e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:29.977979 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-39a4904d-668c-4575-a09e-946509d6387e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:29.985999 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-39a4904d-668c-4575-a09e-946509d6387e tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1555 microversion: 2.1 time: 0.169437 Nov 16 00:34:29.986582 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 399/801] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:34:29 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:34:30.119131 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-a70d8a2e-c005-43b5-81b2-76368acfa3f6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:30.120034 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-a70d8a2e-c005-43b5-81b2-76368acfa3f6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:30.126702 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a4303aa3-e2b2-4acc-9d9e-29fcfb2faf8a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:30.128258 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a70d8a2e-c005-43b5-81b2-76368acfa3f6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:30.128258 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a70d8a2e-c005-43b5-81b2-76368acfa3f6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:30.128545 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a4303aa3-e2b2-4acc-9d9e-29fcfb2faf8a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:30.128782 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a70d8a2e-c005-43b5-81b2-76368acfa3f6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:30.129206 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a70d8a2e-c005-43b5-81b2-76368acfa3f6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:30.134831 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a4303aa3-e2b2-4acc-9d9e-29fcfb2faf8a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:30.135335 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a4303aa3-e2b2-4acc-9d9e-29fcfb2faf8a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:30.136199 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a4303aa3-e2b2-4acc-9d9e-29fcfb2faf8a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:30.136718 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a4303aa3-e2b2-4acc-9d9e-29fcfb2faf8a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:30.212461 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-a70d8a2e-c005-43b5-81b2-76368acfa3f6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 29489 microversion: 2.1 time: 0.097311 Nov 16 00:34:30.213106 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 403/802] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:30 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 29489 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:34:30.228681 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a4303aa3-e2b2-4acc-9d9e-29fcfb2faf8a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 28638 microversion: 2.20 time: 0.106395 Nov 16 00:34:30.229335 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 400/803] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:30 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 28638 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:34:31.010635 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-4400dc52-5f27-439d-8777-de6ef5dc73ab tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:31.011569 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-4400dc52-5f27-439d-8777-de6ef5dc73ab tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:31.018867 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4400dc52-5f27-439d-8777-de6ef5dc73ab tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:31.019342 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4400dc52-5f27-439d-8777-de6ef5dc73ab tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:31.020441 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4400dc52-5f27-439d-8777-de6ef5dc73ab tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:31.020862 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4400dc52-5f27-439d-8777-de6ef5dc73ab tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:31.225364 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-c5dfad80-7163-4ba3-89ce-7ac1483cccaf tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:31.226353 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-c5dfad80-7163-4ba3-89ce-7ac1483cccaf tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:31.233762 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c5dfad80-7163-4ba3-89ce-7ac1483cccaf tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:31.234203 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c5dfad80-7163-4ba3-89ce-7ac1483cccaf tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:31.234963 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c5dfad80-7163-4ba3-89ce-7ac1483cccaf tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:31.235484 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c5dfad80-7163-4ba3-89ce-7ac1483cccaf tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:31.265768 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-4400dc52-5f27-439d-8777-de6ef5dc73ab tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:31.273764 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-4400dc52-5f27-439d-8777-de6ef5dc73ab tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1555 microversion: 2.1 time: 0.267126 Nov 16 00:34:31.274560 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 404/804] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:34:31 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1555 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:34:31.279073 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1e3c2b50-bbea-4e1c-a660-2692548f3453 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:31.280121 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1e3c2b50-bbea-4e1c-a660-2692548f3453 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:31.287106 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1e3c2b50-bbea-4e1c-a660-2692548f3453 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:31.287557 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1e3c2b50-bbea-4e1c-a660-2692548f3453 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:31.288326 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1e3c2b50-bbea-4e1c-a660-2692548f3453 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:31.288757 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1e3c2b50-bbea-4e1c-a660-2692548f3453 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:33.173270 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-c5dfad80-7163-4ba3-89ce-7ac1483cccaf tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 30995 microversion: 2.1 time: 1.952319 Nov 16 00:34:33.175115 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 401/805] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:31 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 30995 bytes in 1954 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:34:33.179754 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-52891c1f-91c9-4b21-b0bd-c11ca458e21d req-65d80db8-5673-457c-b8a2-75e6c2e5efff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81", "name": "network-vif-deleted", "tag": "766ca728-c4c6-4a74-b3aa-0075802cbf56"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:33.181427 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:34:33.181427 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:34:33.189512 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-52891c1f-91c9-4b21-b0bd-c11ca458e21d req-65d80db8-5673-457c-b8a2-75e6c2e5efff service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:33.189830 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-52891c1f-91c9-4b21-b0bd-c11ca458e21d req-65d80db8-5673-457c-b8a2-75e6c2e5efff service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:33.202755 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-52891c1f-91c9-4b21-b0bd-c11ca458e21d req-65d80db8-5673-457c-b8a2-75e6c2e5efff service nova] Creating event network-vif-deleted:766ca728-c4c6-4a74-b3aa-0075802cbf56 for instance 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 on hv-cinder-81115 Nov 16 00:34:33.208580 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-52891c1f-91c9-4b21-b0bd-c11ca458e21d req-65d80db8-5673-457c-b8a2-75e6c2e5efff service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032790 Nov 16 00:34:33.209308 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 402/806] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:34:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:34:33.214250 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-cd62c253-d862-42ad-bfa6-dbbe752a75c0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:33.214950 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-cd62c253-d862-42ad-bfa6-dbbe752a75c0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:33.222395 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cd62c253-d862-42ad-bfa6-dbbe752a75c0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:33.222852 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cd62c253-d862-42ad-bfa6-dbbe752a75c0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:33.223657 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cd62c253-d862-42ad-bfa6-dbbe752a75c0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:33.224091 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cd62c253-d862-42ad-bfa6-dbbe752a75c0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:33.290491 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-cd62c253-d862-42ad-bfa6-dbbe752a75c0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:33.298102 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-cd62c253-d862-42ad-bfa6-dbbe752a75c0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1513 microversion: 2.1 time: 0.087554 Nov 16 00:34:33.298679 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 403/807] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:34:33 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1513 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:34:34.184815 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f38d3ee1-430d-4158-9a5b-86f38dc601ed tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:34.185719 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f38d3ee1-430d-4158-9a5b-86f38dc601ed tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:34.192720 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f38d3ee1-430d-4158-9a5b-86f38dc601ed tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:34.193164 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f38d3ee1-430d-4158-9a5b-86f38dc601ed tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:34.193940 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f38d3ee1-430d-4158-9a5b-86f38dc601ed tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:34.194365 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f38d3ee1-430d-4158-9a5b-86f38dc601ed tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:34.252245 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-1e3c2b50-bbea-4e1c-a660-2692548f3453 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 28638 microversion: 2.20 time: 2.976224 Nov 16 00:34:34.254666 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 405/808] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:31 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 28638 bytes in 2979 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:34.298685 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-f38d3ee1-430d-4158-9a5b-86f38dc601ed tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 34364 microversion: 2.1 time: 0.117318 Nov 16 00:34:34.299492 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 404/809] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:34 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 34364 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:34:34.318110 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-bff30cc8-370b-4738-a527-7ad2e81f2ff0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:34.318876 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-bff30cc8-370b-4738-a527-7ad2e81f2ff0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:34.329412 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bff30cc8-370b-4738-a527-7ad2e81f2ff0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:34.330211 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bff30cc8-370b-4738-a527-7ad2e81f2ff0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:34.332133 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bff30cc8-370b-4738-a527-7ad2e81f2ff0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:34.332803 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bff30cc8-370b-4738-a527-7ad2e81f2ff0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:34.366572 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bff30cc8-370b-4738-a527-7ad2e81f2ff0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:34.367008 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bff30cc8-370b-4738-a527-7ad2e81f2ff0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:34.367484 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.objects.instance [None req-bff30cc8-370b-4738-a527-7ad2e81f2ff0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lazy-loading 'fault' on Instance uuid 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 {{(pid=122543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:34:34.410057 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-bff30cc8-370b-4738-a527-7ad2e81f2ff0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1b83dddb4a4bf5bac2ae8804a59f1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4495714639486cad8d6a4039009581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:34.418167 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-bff30cc8-370b-4738-a527-7ad2e81f2ff0 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 200 len: 1348 microversion: 2.1 time: 0.105294 Nov 16 00:34:34.418734 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 406/810] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:34:34 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 1348 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:34:35.267007 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-dc7ffa00-73b4-4956-9991-93a645afb663 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:35.269417 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-dc7ffa00-73b4-4956-9991-93a645afb663 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:35.276789 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dc7ffa00-73b4-4956-9991-93a645afb663 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:35.277329 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dc7ffa00-73b4-4956-9991-93a645afb663 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:35.278155 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dc7ffa00-73b4-4956-9991-93a645afb663 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:35.278669 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dc7ffa00-73b4-4956-9991-93a645afb663 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:35.314163 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-717ae2ea-80fb-4e5b-9b0d-7cacaba612b8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:35.316106 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-717ae2ea-80fb-4e5b-9b0d-7cacaba612b8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:35.325069 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-717ae2ea-80fb-4e5b-9b0d-7cacaba612b8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:35.325521 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-717ae2ea-80fb-4e5b-9b0d-7cacaba612b8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:35.326329 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-717ae2ea-80fb-4e5b-9b0d-7cacaba612b8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:35.326765 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-717ae2ea-80fb-4e5b-9b0d-7cacaba612b8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:35.364309 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-dc7ffa00-73b4-4956-9991-93a645afb663 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 29984 microversion: 2.20 time: 0.101930 Nov 16 00:34:35.365700 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 405/811] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:35 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 29984 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:35.412052 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-717ae2ea-80fb-4e5b-9b0d-7cacaba612b8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 35184 microversion: 2.1 time: 0.103156 Nov 16 00:34:35.412986 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 407/812] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:35 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 35184 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:34:35.439316 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-2ae84df4-4031-40f4-9893-09fff72f8cfb tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:35.439316 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-2ae84df4-4031-40f4-9893-09fff72f8cfb tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] [instance: 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:35.447968 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2ae84df4-4031-40f4-9893-09fff72f8cfb tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:35.448419 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2ae84df4-4031-40f4-9893-09fff72f8cfb tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:35.449324 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2ae84df4-4031-40f4-9893-09fff72f8cfb tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:35.450016 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2ae84df4-4031-40f4-9893-09fff72f8cfb tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:35.466958 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-2ae84df4-4031-40f4-9893-09fff72f8cfb tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] HTTP exception thrown: Instance 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 could not be found. Nov 16 00:34:35.467610 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-2ae84df4-4031-40f4-9893-09fff72f8cfb tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Returning 404 to user: Instance 24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:34:35.468464 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-2ae84df4-4031-40f4-9893-09fff72f8cfb tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81" status: 404 len: 111 microversion: 2.1 time: 0.036466 Nov 16 00:34:35.469019 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 406/813] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:34:35 2021] GET /compute/v2.1/servers/24ea1bfb-2dff-4ebb-adea-8b70b3c6ad81 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 00:34:35.478314 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-7ecafbea-65ca-4fe7-9a05-cb9221ba7093 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] Calling method '.version_select at 0x7f2f295d48b0>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:35.501533 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-7ecafbea-65ca-4fe7-9a05-cb9221ba7093 tempest-TestMinimumBasicScenario-891950418 tempest-TestMinimumBasicScenario-891950418-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1457930364" status: 202 len: 0 microversion: 2.1 time: 0.026723 Nov 16 00:34:35.503416 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 408/814] 10.222.0.31 () {58 vars in 1271 bytes} [Tue Nov 16 00:34:35 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1457930364 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:36.376787 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-7943c7fe-ee45-43ba-9453-205f966c9775 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:36.377777 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-7943c7fe-ee45-43ba-9453-205f966c9775 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:36.384140 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7943c7fe-ee45-43ba-9453-205f966c9775 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:36.384577 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7943c7fe-ee45-43ba-9453-205f966c9775 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:36.385348 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7943c7fe-ee45-43ba-9453-205f966c9775 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:36.385769 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7943c7fe-ee45-43ba-9453-205f966c9775 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:36.427033 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-49ef1d6a-5e6c-4b11-920f-2f7b543533a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:36.429510 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-49ef1d6a-5e6c-4b11-920f-2f7b543533a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:36.439513 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-49ef1d6a-5e6c-4b11-920f-2f7b543533a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:36.440623 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-49ef1d6a-5e6c-4b11-920f-2f7b543533a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:36.441173 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-49ef1d6a-5e6c-4b11-920f-2f7b543533a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:36.441685 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-49ef1d6a-5e6c-4b11-920f-2f7b543533a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:36.465778 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-7943c7fe-ee45-43ba-9453-205f966c9775 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 31600 microversion: 2.20 time: 0.092591 Nov 16 00:34:36.466480 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 407/815] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:36 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 31600 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:36.529020 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-49ef1d6a-5e6c-4b11-920f-2f7b543533a6 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 36264 microversion: 2.1 time: 0.106180 Nov 16 00:34:36.533782 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 409/816] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:36 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 36264 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:34:37.479986 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-55600cb9-2887-484e-80c9-897229196a4b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:37.481209 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-55600cb9-2887-484e-80c9-897229196a4b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:37.488507 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-55600cb9-2887-484e-80c9-897229196a4b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:37.488998 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-55600cb9-2887-484e-80c9-897229196a4b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:37.489728 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-55600cb9-2887-484e-80c9-897229196a4b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:37.490159 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-55600cb9-2887-484e-80c9-897229196a4b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:37.543222 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-b4e24314-6417-4297-a36c-6c4bc1630f25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:37.544394 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b4e24314-6417-4297-a36c-6c4bc1630f25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:37.551143 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b4e24314-6417-4297-a36c-6c4bc1630f25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:37.551679 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b4e24314-6417-4297-a36c-6c4bc1630f25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:37.552571 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b4e24314-6417-4297-a36c-6c4bc1630f25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:37.553065 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b4e24314-6417-4297-a36c-6c4bc1630f25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:37.574681 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-55600cb9-2887-484e-80c9-897229196a4b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 32323 microversion: 2.20 time: 0.098572 Nov 16 00:34:37.575646 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 408/817] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:37 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 32323 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:37.637302 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-b4e24314-6417-4297-a36c-6c4bc1630f25 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 37367 microversion: 2.1 time: 0.098093 Nov 16 00:34:37.638176 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 410/818] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:37 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 37367 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:34:38.589127 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3f1bc857-4800-4c52-aa76-ecd5f6f2059a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:38.590153 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3f1bc857-4800-4c52-aa76-ecd5f6f2059a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:38.597516 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3f1bc857-4800-4c52-aa76-ecd5f6f2059a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:38.598243 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3f1bc857-4800-4c52-aa76-ecd5f6f2059a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:38.599041 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3f1bc857-4800-4c52-aa76-ecd5f6f2059a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:38.599697 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3f1bc857-4800-4c52-aa76-ecd5f6f2059a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:38.650919 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-b210cd20-2671-4a06-8b1c-b49cfceba48d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:38.652213 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b210cd20-2671-4a06-8b1c-b49cfceba48d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:38.659134 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b210cd20-2671-4a06-8b1c-b49cfceba48d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:38.659588 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b210cd20-2671-4a06-8b1c-b49cfceba48d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:38.660759 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b210cd20-2671-4a06-8b1c-b49cfceba48d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:38.661260 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b210cd20-2671-4a06-8b1c-b49cfceba48d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:38.679784 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-3f1bc857-4800-4c52-aa76-ecd5f6f2059a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 33247 microversion: 2.20 time: 0.094685 Nov 16 00:34:38.684790 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 409/819] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:38 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 33247 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:38.764510 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-b210cd20-2671-4a06-8b1c-b49cfceba48d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 38134 microversion: 2.1 time: 0.117707 Nov 16 00:34:38.765303 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 411/820] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:38 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 38134 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:34:39.693525 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-75161e3d-11d7-4de0-9246-464110d291fe tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:39.694520 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-75161e3d-11d7-4de0-9246-464110d291fe tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:39.700917 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-75161e3d-11d7-4de0-9246-464110d291fe tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:39.701365 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-75161e3d-11d7-4de0-9246-464110d291fe tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:39.702211 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-75161e3d-11d7-4de0-9246-464110d291fe tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:39.702678 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-75161e3d-11d7-4de0-9246-464110d291fe tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:39.782568 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-4a05b3e6-a4d1-4a32-b0bb-3017980e8a18 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:39.783162 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-75161e3d-11d7-4de0-9246-464110d291fe tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 34257 microversion: 2.20 time: 0.094174 Nov 16 00:34:39.784479 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 410/821] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:39 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 34257 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:34:39.784888 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-4a05b3e6-a4d1-4a32-b0bb-3017980e8a18 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:39.793499 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4a05b3e6-a4d1-4a32-b0bb-3017980e8a18 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:39.794361 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4a05b3e6-a4d1-4a32-b0bb-3017980e8a18 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:39.795171 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4a05b3e6-a4d1-4a32-b0bb-3017980e8a18 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:39.795778 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4a05b3e6-a4d1-4a32-b0bb-3017980e8a18 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:39.872260 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-4a05b3e6-a4d1-4a32-b0bb-3017980e8a18 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 38134 microversion: 2.1 time: 0.095701 Nov 16 00:34:39.877594 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 412/822] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:39 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 38134 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:34:40.797517 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-c31ca84a-3b89-4b95-b865-20fba7c11057 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:40.798509 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-c31ca84a-3b89-4b95-b865-20fba7c11057 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:40.805226 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c31ca84a-3b89-4b95-b865-20fba7c11057 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:40.805658 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c31ca84a-3b89-4b95-b865-20fba7c11057 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:40.806418 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c31ca84a-3b89-4b95-b865-20fba7c11057 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:40.806835 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c31ca84a-3b89-4b95-b865-20fba7c11057 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:40.879252 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-c31ca84a-3b89-4b95-b865-20fba7c11057 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 35726 microversion: 2.20 time: 0.085398 Nov 16 00:34:40.880422 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 411/823] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:40 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 35726 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:40.885145 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-62b60ff7-d7c2-4ecf-a3fd-0840b8b4e68d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:40.886203 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-62b60ff7-d7c2-4ecf-a3fd-0840b8b4e68d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:40.894366 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-62b60ff7-d7c2-4ecf-a3fd-0840b8b4e68d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:40.894806 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-62b60ff7-d7c2-4ecf-a3fd-0840b8b4e68d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:40.895658 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-62b60ff7-d7c2-4ecf-a3fd-0840b8b4e68d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:40.896087 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-62b60ff7-d7c2-4ecf-a3fd-0840b8b4e68d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:40.964365 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-62b60ff7-d7c2-4ecf-a3fd-0840b8b4e68d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 38134 microversion: 2.1 time: 0.083015 Nov 16 00:34:40.965343 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 413/824] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:40 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 38134 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:34:41.893144 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-01a09865-227c-46c6-be91-23c2a08c0081 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:41.894082 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-01a09865-227c-46c6-be91-23c2a08c0081 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:41.901238 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-01a09865-227c-46c6-be91-23c2a08c0081 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:41.901673 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-01a09865-227c-46c6-be91-23c2a08c0081 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:41.902459 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-01a09865-227c-46c6-be91-23c2a08c0081 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:41.902883 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-01a09865-227c-46c6-be91-23c2a08c0081 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:41.977648 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-157f0ecb-c617-4d0c-a7a4-0c65ec544061 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:41.980069 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-157f0ecb-c617-4d0c-a7a4-0c65ec544061 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:41.990474 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-01a09865-227c-46c6-be91-23c2a08c0081 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 37169 microversion: 2.20 time: 0.102650 Nov 16 00:34:41.992408 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 412/825] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:41 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 37169 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:41.997109 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-157f0ecb-c617-4d0c-a7a4-0c65ec544061 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:41.998281 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-157f0ecb-c617-4d0c-a7a4-0c65ec544061 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:41.999188 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-157f0ecb-c617-4d0c-a7a4-0c65ec544061 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:42.000136 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-157f0ecb-c617-4d0c-a7a4-0c65ec544061 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:42.074705 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-157f0ecb-c617-4d0c-a7a4-0c65ec544061 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action" status: 200 len: 38265 microversion: 2.1 time: 0.101474 Nov 16 00:34:42.075989 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 414/826] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:34:41 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/action => generated 38265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 00:34:42.087654 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d2e081da-65db-4879-bad8-a81628259be7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:42.088242 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d2e081da-65db-4879-bad8-a81628259be7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:42.095169 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d2e081da-65db-4879-bad8-a81628259be7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:42.096890 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d2e081da-65db-4879-bad8-a81628259be7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:42.097848 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d2e081da-65db-4879-bad8-a81628259be7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:42.098285 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d2e081da-65db-4879-bad8-a81628259be7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:42.126292 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d2e081da-65db-4879-bad8-a81628259be7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/ips" status: 200 len: 145 microversion: 2.1 time: 0.042936 Nov 16 00:34:42.126878 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 413/827] 10.222.0.31 () {58 vars in 1247 bytes} [Tue Nov 16 00:34:42 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:34:43.002992 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-39c73dd1-8a00-4ce2-957d-b5bfb3ed899b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:43.004189 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-39c73dd1-8a00-4ce2-957d-b5bfb3ed899b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:43.011178 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-39c73dd1-8a00-4ce2-957d-b5bfb3ed899b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:43.011619 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-39c73dd1-8a00-4ce2-957d-b5bfb3ed899b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:43.012643 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-39c73dd1-8a00-4ce2-957d-b5bfb3ed899b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:43.013086 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-39c73dd1-8a00-4ce2-957d-b5bfb3ed899b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:43.091209 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-39c73dd1-8a00-4ce2-957d-b5bfb3ed899b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 38186 microversion: 2.20 time: 0.092013 Nov 16 00:34:43.092555 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 415/828] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:42 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 38186 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:34:43.600810 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-c2fbd8d2-b4f4-4771-aa9c-df0e05172f3d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15646a90-6277-4d96-9b49-8ce7ca37eb0d"}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:43.602144 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-c2fbd8d2-b4f4-4771-aa9c-df0e05172f3d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:43.609435 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c2fbd8d2-b4f4-4771-aa9c-df0e05172f3d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:43.610062 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c2fbd8d2-b4f4-4771-aa9c-df0e05172f3d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:43.610961 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c2fbd8d2-b4f4-4771-aa9c-df0e05172f3d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:43.612276 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c2fbd8d2-b4f4-4771-aa9c-df0e05172f3d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:43.968543 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-c2fbd8d2-b4f4-4771-aa9c-df0e05172f3d tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372999 Nov 16 00:34:43.969276 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 414/829] 10.222.0.31 () {60 vars in 1322 bytes} [Tue Nov 16 00:34:43 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:34:44.110510 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-5dc0f81e-1c02-4160-9eac-ccbff972d002 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:44.114165 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-5dc0f81e-1c02-4160-9eac-ccbff972d002 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:44.129575 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5dc0f81e-1c02-4160-9eac-ccbff972d002 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:44.130540 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5dc0f81e-1c02-4160-9eac-ccbff972d002 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:44.132491 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5dc0f81e-1c02-4160-9eac-ccbff972d002 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:44.133540 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5dc0f81e-1c02-4160-9eac-ccbff972d002 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:44.214628 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-5dc0f81e-1c02-4160-9eac-ccbff972d002 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 38186 microversion: 2.20 time: 0.111173 Nov 16 00:34:44.216546 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 416/830] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:44 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 38186 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:34:45.231449 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-4fa60808-d60c-4565-9879-2aa6088bdf66 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:45.232473 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-4fa60808-d60c-4565-9879-2aa6088bdf66 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:45.240001 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4fa60808-d60c-4565-9879-2aa6088bdf66 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:45.240439 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4fa60808-d60c-4565-9879-2aa6088bdf66 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:45.241209 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4fa60808-d60c-4565-9879-2aa6088bdf66 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:45.241631 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4fa60808-d60c-4565-9879-2aa6088bdf66 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:45.318393 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-4fa60808-d60c-4565-9879-2aa6088bdf66 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 38186 microversion: 2.20 time: 0.091236 Nov 16 00:34:45.319993 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 415/831] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:45 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 38186 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:46.330976 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f6736444-0874-4970-9f51-a0b88a514fa2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:46.332899 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f6736444-0874-4970-9f51-a0b88a514fa2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:46.340248 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f6736444-0874-4970-9f51-a0b88a514fa2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:46.340743 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f6736444-0874-4970-9f51-a0b88a514fa2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:46.341587 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f6736444-0874-4970-9f51-a0b88a514fa2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:46.342216 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f6736444-0874-4970-9f51-a0b88a514fa2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:46.414316 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f6736444-0874-4970-9f51-a0b88a514fa2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 200 len: 38329 microversion: 2.20 time: 0.087802 Nov 16 00:34:46.415192 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 417/832] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:46 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 38329 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:34:46.427238 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-43d65890-4473-4e36-a50e-e533ed59065a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:46.427850 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-43d65890-4473-4e36-a50e-e533ed59065a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:46.434805 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-43d65890-4473-4e36-a50e-e533ed59065a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:46.435258 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-43d65890-4473-4e36-a50e-e533ed59065a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:46.436042 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-43d65890-4473-4e36-a50e-e533ed59065a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:46.436517 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-43d65890-4473-4e36-a50e-e533ed59065a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:46.462961 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-43d65890-4473-4e36-a50e-e533ed59065a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/ips" status: 200 len: 151 microversion: 2.20 time: 0.041240 Nov 16 00:34:46.463569 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 416/833] 10.222.0.31 () {60 vars in 1288 bytes} [Tue Nov 16 00:34:46 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:34:48.631727 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-0bedc8cf-9d16-4c18-8bb4-ce34a736d0a6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:48.632988 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-0bedc8cf-9d16-4c18-8bb4-ce34a736d0a6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:48.643576 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0bedc8cf-9d16-4c18-8bb4-ce34a736d0a6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:48.644288 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0bedc8cf-9d16-4c18-8bb4-ce34a736d0a6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:48.645121 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0bedc8cf-9d16-4c18-8bb4-ce34a736d0a6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:48.645554 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0bedc8cf-9d16-4c18-8bb4-ce34a736d0a6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:48.670393 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.objects.instance [None req-0bedc8cf-9d16-4c18-8bb4-ce34a736d0a6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lazy-loading 'flavor' on Instance uuid 5cabac73-4f43-4f58-941d-fcde21d2fdf2 {{(pid=122543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:34:48.951355 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-0bedc8cf-9d16-4c18-8bb4-ce34a736d0a6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 202 len: 0 microversion: 2.20 time: 0.324218 Nov 16 00:34:48.955000 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 418/834] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:34:48 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 16 00:34:48.961383 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0a587bb6-22e4-41ed-8623-41c897fde857 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:48.962135 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0a587bb6-22e4-41ed-8623-41c897fde857 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:48.968889 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0a587bb6-22e4-41ed-8623-41c897fde857 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:48.969437 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0a587bb6-22e4-41ed-8623-41c897fde857 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:48.970307 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0a587bb6-22e4-41ed-8623-41c897fde857 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:48.971687 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0a587bb6-22e4-41ed-8623-41c897fde857 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:49.288280 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0a587bb6-22e4-41ed-8623-41c897fde857 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:49.296560 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0a587bb6-22e4-41ed-8623-41c897fde857 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:49.298577 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0a587bb6-22e4-41ed-8623-41c897fde857 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:49.300740 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0a587bb6-22e4-41ed-8623-41c897fde857 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1723 microversion: 2.20 time: 0.343499 Nov 16 00:34:49.301968 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 417/835] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:34:48 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1723 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:34:50.323089 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-a771962b-fda4-45e0-909e-63fffa0d5d6b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:50.324554 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-a771962b-fda4-45e0-909e-63fffa0d5d6b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:50.340242 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a771962b-fda4-45e0-909e-63fffa0d5d6b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:50.341002 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a771962b-fda4-45e0-909e-63fffa0d5d6b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:50.342230 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a771962b-fda4-45e0-909e-63fffa0d5d6b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:50.342831 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a771962b-fda4-45e0-909e-63fffa0d5d6b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:50.533682 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-a771962b-fda4-45e0-909e-63fffa0d5d6b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:50.545902 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-a771962b-fda4-45e0-909e-63fffa0d5d6b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:50.548480 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-a771962b-fda4-45e0-909e-63fffa0d5d6b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:50.551588 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-a771962b-fda4-45e0-909e-63fffa0d5d6b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1723 microversion: 2.20 time: 0.233678 Nov 16 00:34:50.552667 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 419/836] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:34:50 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:34:50.680737 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-7246c2b2-407d-4a69-a000-35bcab1cd6ef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:50.681597 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-7246c2b2-407d-4a69-a000-35bcab1cd6ef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:50.704485 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7246c2b2-407d-4a69-a000-35bcab1cd6ef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:50.706026 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7246c2b2-407d-4a69-a000-35bcab1cd6ef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:50.708001 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7246c2b2-407d-4a69-a000-35bcab1cd6ef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:50.709189 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7246c2b2-407d-4a69-a000-35bcab1cd6ef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:50.770825 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-7246c2b2-407d-4a69-a000-35bcab1cd6ef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097008 Nov 16 00:34:50.772278 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 418/837] 10.222.0.31 () {58 vars in 1301 bytes} [Tue Nov 16 00:34:50 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:34:50.782130 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-a8c4214e-636b-478a-88d8-71cca0e5f26a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:50.782628 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-a8c4214e-636b-478a-88d8-71cca0e5f26a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:50.793266 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a8c4214e-636b-478a-88d8-71cca0e5f26a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:50.801447 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a8c4214e-636b-478a-88d8-71cca0e5f26a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:50.801447 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a8c4214e-636b-478a-88d8-71cca0e5f26a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:50.801447 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a8c4214e-636b-478a-88d8-71cca0e5f26a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:50.841162 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-a8c4214e-636b-478a-88d8-71cca0e5f26a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments/15646a90-6277-4d96-9b49-8ce7ca37eb0d" status: 200 len: 194 microversion: 2.1 time: 0.063190 Nov 16 00:34:50.841912 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 420/838] 10.222.0.31 () {58 vars in 1412 bytes} [Tue Nov 16 00:34:50 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments/15646a90-6277-4d96-9b49-8ce7ca37eb0d => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:34:51.569778 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d9971035-65a3-4091-9cd4-c83e70357dc9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:51.570574 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d9971035-65a3-4091-9cd4-c83e70357dc9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:51.581910 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d9971035-65a3-4091-9cd4-c83e70357dc9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:51.582647 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d9971035-65a3-4091-9cd4-c83e70357dc9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:51.583993 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d9971035-65a3-4091-9cd4-c83e70357dc9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:51.584603 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d9971035-65a3-4091-9cd4-c83e70357dc9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:51.918976 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d9971035-65a3-4091-9cd4-c83e70357dc9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:51.931116 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d9971035-65a3-4091-9cd4-c83e70357dc9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:51.934610 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d9971035-65a3-4091-9cd4-c83e70357dc9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:51.935928 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d9971035-65a3-4091-9cd4-c83e70357dc9 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1723 microversion: 2.20 time: 0.369914 Nov 16 00:34:51.936720 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 419/839] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:34:51 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:34:52.263593 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-4c152dea-78b8-4c9a-8549-b3ed999ec69a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4508e029-3862-4621-b9c4-1a8d3a81bf75"}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:52.264710 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-4c152dea-78b8-4c9a-8549-b3ed999ec69a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:52.270653 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4c152dea-78b8-4c9a-8549-b3ed999ec69a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:52.271135 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4c152dea-78b8-4c9a-8549-b3ed999ec69a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:52.271915 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4c152dea-78b8-4c9a-8549-b3ed999ec69a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:52.272336 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4c152dea-78b8-4c9a-8549-b3ed999ec69a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:52.584274 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-4c152dea-78b8-4c9a-8549-b3ed999ec69a tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324216 Nov 16 00:34:52.585132 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 421/840] 10.222.0.31 () {60 vars in 1322 bytes} [Tue Nov 16 00:34:52 2021] POST /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:34:52.958596 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d83b156f-c8c7-49e3-badc-2f5630027c8f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:52.959327 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d83b156f-c8c7-49e3-badc-2f5630027c8f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:52.966709 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d83b156f-c8c7-49e3-badc-2f5630027c8f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:52.967318 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d83b156f-c8c7-49e3-badc-2f5630027c8f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:52.968180 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d83b156f-c8c7-49e3-badc-2f5630027c8f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:52.968661 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d83b156f-c8c7-49e3-badc-2f5630027c8f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:53.211825 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d83b156f-c8c7-49e3-badc-2f5630027c8f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:53.220081 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d83b156f-c8c7-49e3-badc-2f5630027c8f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:53.222780 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d83b156f-c8c7-49e3-badc-2f5630027c8f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:53.224077 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d83b156f-c8c7-49e3-badc-2f5630027c8f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1723 microversion: 2.20 time: 0.270203 Nov 16 00:34:53.224726 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 420/841] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:34:52 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:34:54.245796 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-272d6bde-0ef7-4b10-95ca-0e2a10a58745 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:54.247349 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-272d6bde-0ef7-4b10-95ca-0e2a10a58745 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:54.259523 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-272d6bde-0ef7-4b10-95ca-0e2a10a58745 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:54.260355 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-272d6bde-0ef7-4b10-95ca-0e2a10a58745 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:54.261345 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-272d6bde-0ef7-4b10-95ca-0e2a10a58745 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:54.261946 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-272d6bde-0ef7-4b10-95ca-0e2a10a58745 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:54.426305 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-272d6bde-0ef7-4b10-95ca-0e2a10a58745 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:54.447822 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-272d6bde-0ef7-4b10-95ca-0e2a10a58745 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:54.452303 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-272d6bde-0ef7-4b10-95ca-0e2a10a58745 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:54.453791 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-272d6bde-0ef7-4b10-95ca-0e2a10a58745 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1723 microversion: 2.20 time: 0.213460 Nov 16 00:34:54.454524 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 422/842] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:34:54 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:34:55.474814 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e03754ab-b375-4804-a095-298468b9c57f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:55.483975 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e03754ab-b375-4804-a095-298468b9c57f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:55.497141 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e03754ab-b375-4804-a095-298468b9c57f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:55.497907 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e03754ab-b375-4804-a095-298468b9c57f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:55.505466 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e03754ab-b375-4804-a095-298468b9c57f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:55.507348 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e03754ab-b375-4804-a095-298468b9c57f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:55.686875 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e03754ab-b375-4804-a095-298468b9c57f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:55.700459 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e03754ab-b375-4804-a095-298468b9c57f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:55.704392 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e03754ab-b375-4804-a095-298468b9c57f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:55.707736 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e03754ab-b375-4804-a095-298468b9c57f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1723 microversion: 2.20 time: 0.237897 Nov 16 00:34:55.709112 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 421/843] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:34:55 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:34:56.726940 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-06e80c7e-e6a0-416c-93ec-da82b723877f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:56.727956 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-06e80c7e-e6a0-416c-93ec-da82b723877f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:56.735396 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-06e80c7e-e6a0-416c-93ec-da82b723877f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:56.736024 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-06e80c7e-e6a0-416c-93ec-da82b723877f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:56.737598 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-06e80c7e-e6a0-416c-93ec-da82b723877f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:56.738115 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-06e80c7e-e6a0-416c-93ec-da82b723877f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:56.956838 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-06e80c7e-e6a0-416c-93ec-da82b723877f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:56.976448 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-06e80c7e-e6a0-416c-93ec-da82b723877f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:56.977950 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-06e80c7e-e6a0-416c-93ec-da82b723877f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:56.979342 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-06e80c7e-e6a0-416c-93ec-da82b723877f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1723 microversion: 2.20 time: 0.256617 Nov 16 00:34:56.993407 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 423/844] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:34:56 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:34:57.713030 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-86833df6-35bd-40e3-9874-fae0642657c5 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Action: 'create', calling method: .version_select at 0x7f2f2974d8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1578337872"}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:34:57.734573 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-86833df6-35bd-40e3-9874-fae0642657c5 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Getting quotas for project 8b1da70dc7334be3be9b115125527150. Resources: {'key_pairs'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:34:57.740852 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-86833df6-35bd-40e3-9874-fae0642657c5 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Getting quotas for user 456426d38d9c4cd3be59d047a845d8b5 and project 8b1da70dc7334be3be9b115125527150. Resources: {'key_pairs'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:34:57.854292 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-86833df6-35bd-40e3-9874-fae0642657c5 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Getting quotas for project 8b1da70dc7334be3be9b115125527150. Resources: {'key_pairs'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:34:57.858197 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-86833df6-35bd-40e3-9874-fae0642657c5 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Getting quotas for user 456426d38d9c4cd3be59d047a845d8b5 and project 8b1da70dc7334be3be9b115125527150. Resources: {'key_pairs'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:34:57.883606 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-86833df6-35bd-40e3-9874-fae0642657c5 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.357928 Nov 16 00:34:57.884681 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 422/845] 10.222.0.31 () {60 vars in 1157 bytes} [Tue Nov 16 00:34:57 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:34:57.998471 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-a2586645-77fa-4554-910e-e343fbfd46dd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:58.000637 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-a2586645-77fa-4554-910e-e343fbfd46dd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:58.010389 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a2586645-77fa-4554-910e-e343fbfd46dd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:58.011030 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a2586645-77fa-4554-910e-e343fbfd46dd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:58.012161 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a2586645-77fa-4554-910e-e343fbfd46dd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:58.012601 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a2586645-77fa-4554-910e-e343fbfd46dd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:58.223890 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-a2586645-77fa-4554-910e-e343fbfd46dd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:58.232770 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-a2586645-77fa-4554-910e-e343fbfd46dd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:58.234861 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-a2586645-77fa-4554-910e-e343fbfd46dd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:58.237019 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-a2586645-77fa-4554-910e-e343fbfd46dd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1723 microversion: 2.20 time: 0.242167 Nov 16 00:34:58.238559 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 424/846] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:34:57 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:34:59.188454 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-8559fa63-c519-4bec-b85a-68701881f5a8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:59.189403 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-8559fa63-c519-4bec-b85a-68701881f5a8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:59.195178 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8559fa63-c519-4bec-b85a-68701881f5a8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:59.195616 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8559fa63-c519-4bec-b85a-68701881f5a8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:59.196374 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8559fa63-c519-4bec-b85a-68701881f5a8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:59.196797 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8559fa63-c519-4bec-b85a-68701881f5a8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:59.228021 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-8559fa63-c519-4bec-b85a-68701881f5a8 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043520 Nov 16 00:34:59.228587 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 423/847] 10.222.0.31 () {58 vars in 1301 bytes} [Tue Nov 16 00:34:59 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:34:59.256559 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-b38154ed-da87-4791-98c6-57cdb1086809 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:59.257452 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b38154ed-da87-4791-98c6-57cdb1086809 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:59.267194 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b38154ed-da87-4791-98c6-57cdb1086809 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:59.268459 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b38154ed-da87-4791-98c6-57cdb1086809 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:59.269465 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b38154ed-da87-4791-98c6-57cdb1086809 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:59.269899 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b38154ed-da87-4791-98c6-57cdb1086809 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:59.402977 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0a35bee2-2a30-4717-a388-fd5934233077 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:59.403550 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0a35bee2-2a30-4717-a388-fd5934233077 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:59.409317 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0a35bee2-2a30-4717-a388-fd5934233077 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:59.409755 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0a35bee2-2a30-4717-a388-fd5934233077 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:59.410776 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0a35bee2-2a30-4717-a388-fd5934233077 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:59.411284 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0a35bee2-2a30-4717-a388-fd5934233077 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:59.428680 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-b38154ed-da87-4791-98c6-57cdb1086809 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:59.437864 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-b38154ed-da87-4791-98c6-57cdb1086809 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:59.440497 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-b38154ed-da87-4791-98c6-57cdb1086809 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:34:59.441931 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-b38154ed-da87-4791-98c6-57cdb1086809 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1723 microversion: 2.20 time: 0.190245 Nov 16 00:34:59.443033 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 425/848] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:34:59 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:34:59.445643 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0a35bee2-2a30-4717-a388-fd5934233077 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments/15646a90-6277-4d96-9b49-8ce7ca37eb0d" status: 200 len: 194 microversion: 2.1 time: 0.046825 Nov 16 00:34:59.450655 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 424/849] 10.222.0.31 () {58 vars in 1412 bytes} [Tue Nov 16 00:34:59 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments/15646a90-6277-4d96-9b49-8ce7ca37eb0d => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:34:59.457517 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-725ab37f-a443-47d0-8f7f-44587b2321ef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:34:59.458013 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-725ab37f-a443-47d0-8f7f-44587b2321ef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:34:59.464038 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-725ab37f-a443-47d0-8f7f-44587b2321ef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:59.464674 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-725ab37f-a443-47d0-8f7f-44587b2321ef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:59.465616 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-725ab37f-a443-47d0-8f7f-44587b2321ef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:34:59.466192 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-725ab37f-a443-47d0-8f7f-44587b2321ef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:34:59.566624 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.objects.instance [None req-725ab37f-a443-47d0-8f7f-44587b2321ef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lazy-loading 'services' on Instance uuid 1720981e-6170-4ee8-b78c-8ecc7b7e3383 {{(pid=122543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:34:59.653145 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-725ab37f-a443-47d0-8f7f-44587b2321ef tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments/15646a90-6277-4d96-9b49-8ce7ca37eb0d" status: 202 len: 0 microversion: 2.1 time: 0.200944 Nov 16 00:34:59.653729 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 426/850] 10.222.0.31 () {58 vars in 1415 bytes} [Tue Nov 16 00:34:59 2021] DELETE /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments/15646a90-6277-4d96-9b49-8ce7ca37eb0d => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:35:00.460141 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d226dc94-f99a-4267-aa2c-03e14c564819 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:00.460834 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d226dc94-f99a-4267-aa2c-03e14c564819 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:00.466567 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d226dc94-f99a-4267-aa2c-03e14c564819 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:00.467224 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d226dc94-f99a-4267-aa2c-03e14c564819 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:00.467878 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d226dc94-f99a-4267-aa2c-03e14c564819 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:00.468308 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d226dc94-f99a-4267-aa2c-03e14c564819 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:00.596623 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d226dc94-f99a-4267-aa2c-03e14c564819 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:00.604700 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d226dc94-f99a-4267-aa2c-03e14c564819 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:00.606210 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d226dc94-f99a-4267-aa2c-03e14c564819 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:00.607707 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d226dc94-f99a-4267-aa2c-03e14c564819 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1723 microversion: 2.20 time: 0.151206 Nov 16 00:35:00.608587 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 425/851] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:00 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:00.803589 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-52b79457-cd7a-4bdf-a6b7-5d3b93fec384 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:00.804831 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-52b79457-cd7a-4bdf-a6b7-5d3b93fec384 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:00.811823 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-52b79457-cd7a-4bdf-a6b7-5d3b93fec384 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:00.812271 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-52b79457-cd7a-4bdf-a6b7-5d3b93fec384 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:00.813060 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-52b79457-cd7a-4bdf-a6b7-5d3b93fec384 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:00.813494 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-52b79457-cd7a-4bdf-a6b7-5d3b93fec384 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:00.852383 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-52b79457-cd7a-4bdf-a6b7-5d3b93fec384 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments/4508e029-3862-4621-b9c4-1a8d3a81bf75" status: 200 len: 194 microversion: 2.1 time: 0.054554 Nov 16 00:35:00.853336 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 427/852] 10.222.0.31 () {58 vars in 1412 bytes} [Tue Nov 16 00:35:00 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments/4508e029-3862-4621-b9c4-1a8d3a81bf75 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:35:00.867912 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-b375f402-d629-449b-8740-66e351576ece tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:00.868748 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-b375f402-d629-449b-8740-66e351576ece tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:00.875795 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b375f402-d629-449b-8740-66e351576ece tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:00.876236 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b375f402-d629-449b-8740-66e351576ece tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:00.877058 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b375f402-d629-449b-8740-66e351576ece tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:00.877482 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b375f402-d629-449b-8740-66e351576ece tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:00.989120 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.objects.instance [None req-b375f402-d629-449b-8740-66e351576ece tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lazy-loading 'services' on Instance uuid 1720981e-6170-4ee8-b78c-8ecc7b7e3383 {{(pid=122544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:35:01.099588 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-b375f402-d629-449b-8740-66e351576ece tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments/4508e029-3862-4621-b9c4-1a8d3a81bf75" status: 202 len: 0 microversion: 2.1 time: 0.239927 Nov 16 00:35:01.100902 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 426/853] 10.222.0.31 () {58 vars in 1415 bytes} [Tue Nov 16 00:35:00 2021] DELETE /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments/4508e029-3862-4621-b9c4-1a8d3a81bf75 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:35:01.627689 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-d9c61caa-d418-47d6-b5f7-b68a59adfe78 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:01.628741 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d9c61caa-d418-47d6-b5f7-b68a59adfe78 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:01.635665 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d9c61caa-d418-47d6-b5f7-b68a59adfe78 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:01.636099 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d9c61caa-d418-47d6-b5f7-b68a59adfe78 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:01.637237 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d9c61caa-d418-47d6-b5f7-b68a59adfe78 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:01.637849 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d9c61caa-d418-47d6-b5f7-b68a59adfe78 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:01.787849 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-d9c61caa-d418-47d6-b5f7-b68a59adfe78 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:01.795796 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-d9c61caa-d418-47d6-b5f7-b68a59adfe78 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:01.797290 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-d9c61caa-d418-47d6-b5f7-b68a59adfe78 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:01.799497 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-d9c61caa-d418-47d6-b5f7-b68a59adfe78 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1723 microversion: 2.20 time: 0.176219 Nov 16 00:35:01.800281 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 428/854] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:01 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:02.356343 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-bcb7c54e-613d-457c-acc0-b1125791234b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:02.357481 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-bcb7c54e-613d-457c-acc0-b1125791234b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:02.364476 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bcb7c54e-613d-457c-acc0-b1125791234b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:02.364919 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bcb7c54e-613d-457c-acc0-b1125791234b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:02.365686 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bcb7c54e-613d-457c-acc0-b1125791234b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:02.366112 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bcb7c54e-613d-457c-acc0-b1125791234b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:02.396166 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-bcb7c54e-613d-457c-acc0-b1125791234b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044137 Nov 16 00:35:02.396731 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 427/855] 10.222.0.31 () {58 vars in 1301 bytes} [Tue Nov 16 00:35:02 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:35:02.519820 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-048e51a8-a10e-43eb-bf14-7e03a431d983 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:02.520895 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-048e51a8-a10e-43eb-bf14-7e03a431d983 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:02.526890 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-048e51a8-a10e-43eb-bf14-7e03a431d983 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:02.527526 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-048e51a8-a10e-43eb-bf14-7e03a431d983 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:02.528303 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-048e51a8-a10e-43eb-bf14-7e03a431d983 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:02.528735 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-048e51a8-a10e-43eb-bf14-7e03a431d983 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:02.560108 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-048e51a8-a10e-43eb-bf14-7e03a431d983 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045235 Nov 16 00:35:02.560656 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 429/856] 10.222.0.31 () {58 vars in 1301 bytes} [Tue Nov 16 00:35:02 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:35:02.621464 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f2cb2bc7-3beb-4061-ae71-b681c27f3022 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:02.622039 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f2cb2bc7-3beb-4061-ae71-b681c27f3022 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:02.629793 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f2cb2bc7-3beb-4061-ae71-b681c27f3022 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:02.630237 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f2cb2bc7-3beb-4061-ae71-b681c27f3022 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:02.631023 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f2cb2bc7-3beb-4061-ae71-b681c27f3022 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:02.631550 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f2cb2bc7-3beb-4061-ae71-b681c27f3022 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:02.656161 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f2cb2bc7-3beb-4061-ae71-b681c27f3022 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Going to try to terminate instance {{(pid=122544) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:35:02.737848 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-f2cb2bc7-3beb-4061-ae71-b681c27f3022 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383" status: 204 len: 0 microversion: 2.1 time: 0.119994 Nov 16 00:35:02.739748 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 428/857] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:35:02 2021] DELETE /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 00:35:02.747977 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f27a7719-2eeb-49e6-8d73-c448c992412c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:02.748582 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f27a7719-2eeb-49e6-8d73-c448c992412c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:02.756117 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f27a7719-2eeb-49e6-8d73-c448c992412c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:02.756746 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f27a7719-2eeb-49e6-8d73-c448c992412c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:02.760188 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f27a7719-2eeb-49e6-8d73-c448c992412c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:02.760839 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f27a7719-2eeb-49e6-8d73-c448c992412c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:02.818679 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-abe6947a-085f-46f6-94d4-7b3573dd951a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:02.819438 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-abe6947a-085f-46f6-94d4-7b3573dd951a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:02.825496 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-abe6947a-085f-46f6-94d4-7b3573dd951a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:02.825936 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-abe6947a-085f-46f6-94d4-7b3573dd951a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:02.826706 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-abe6947a-085f-46f6-94d4-7b3573dd951a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:02.827179 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-abe6947a-085f-46f6-94d4-7b3573dd951a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:02.893754 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f27a7719-2eeb-49e6-8d73-c448c992412c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:02.901070 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f27a7719-2eeb-49e6-8d73-c448c992412c tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383" status: 200 len: 1673 microversion: 2.1 time: 0.156565 Nov 16 00:35:02.901654 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 430/858] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:02 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:02.956550 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-abe6947a-085f-46f6-94d4-7b3573dd951a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:02.964352 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-abe6947a-085f-46f6-94d4-7b3573dd951a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:02.965880 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-abe6947a-085f-46f6-94d4-7b3573dd951a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:02.967034 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-abe6947a-085f-46f6-94d4-7b3573dd951a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1723 microversion: 2.20 time: 0.153105 Nov 16 00:35:02.967610 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 429/859] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:02 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:35:03.918951 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-df06c413-6049-47fa-8a64-f17038f81f9b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:03.919800 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-df06c413-6049-47fa-8a64-f17038f81f9b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:03.926195 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-df06c413-6049-47fa-8a64-f17038f81f9b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:03.926652 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-df06c413-6049-47fa-8a64-f17038f81f9b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:03.927479 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-df06c413-6049-47fa-8a64-f17038f81f9b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:03.927914 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-df06c413-6049-47fa-8a64-f17038f81f9b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:03.985111 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-34189dd0-2d12-47e2-8be1-1b518d51fe01 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:03.985701 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-34189dd0-2d12-47e2-8be1-1b518d51fe01 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:03.993400 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-34189dd0-2d12-47e2-8be1-1b518d51fe01 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:03.993874 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-34189dd0-2d12-47e2-8be1-1b518d51fe01 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:03.994698 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-34189dd0-2d12-47e2-8be1-1b518d51fe01 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:03.995156 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-34189dd0-2d12-47e2-8be1-1b518d51fe01 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:04.058883 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-df06c413-6049-47fa-8a64-f17038f81f9b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:04.068105 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-df06c413-6049-47fa-8a64-f17038f81f9b tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383" status: 200 len: 1673 microversion: 2.1 time: 0.153183 Nov 16 00:35:04.068672 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 431/860] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:03 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:04.140398 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-34189dd0-2d12-47e2-8be1-1b518d51fe01 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:04.149582 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-34189dd0-2d12-47e2-8be1-1b518d51fe01 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:04.151117 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-34189dd0-2d12-47e2-8be1-1b518d51fe01 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:04.152315 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-34189dd0-2d12-47e2-8be1-1b518d51fe01 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1723 microversion: 2.20 time: 0.171448 Nov 16 00:35:04.152877 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 430/861] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:03 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:35:05.085972 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-b559e725-a90b-4088-96b0-87b28716975e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:05.086628 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b559e725-a90b-4088-96b0-87b28716975e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:05.092428 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b559e725-a90b-4088-96b0-87b28716975e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:05.092856 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b559e725-a90b-4088-96b0-87b28716975e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:05.093627 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b559e725-a90b-4088-96b0-87b28716975e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:05.094060 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b559e725-a90b-4088-96b0-87b28716975e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:05.171703 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-c79bc850-66b4-46f4-b8dd-5761f7727d22 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:05.172322 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-c79bc850-66b4-46f4-b8dd-5761f7727d22 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:05.191178 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c79bc850-66b4-46f4-b8dd-5761f7727d22 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:05.191924 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c79bc850-66b4-46f4-b8dd-5761f7727d22 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:05.192969 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c79bc850-66b4-46f4-b8dd-5761f7727d22 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:05.193146 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-b559e725-a90b-4088-96b0-87b28716975e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722e3d22cb754e55aec75f2b8b24ca19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f2408fc1d043e581cf3406f493b307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:05.194152 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c79bc850-66b4-46f4-b8dd-5761f7727d22 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:05.203445 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-b559e725-a90b-4088-96b0-87b28716975e tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383" status: 200 len: 1605 microversion: 2.1 time: 0.121006 Nov 16 00:35:05.204016 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 432/862] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:05 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383 => generated 1605 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:05.322906 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-c79bc850-66b4-46f4-b8dd-5761f7727d22 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:05.334303 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-c79bc850-66b4-46f4-b8dd-5761f7727d22 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:05.335826 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-c79bc850-66b4-46f4-b8dd-5761f7727d22 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:05.337086 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-c79bc850-66b4-46f4-b8dd-5761f7727d22 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1744 microversion: 2.20 time: 0.169350 Nov 16 00:35:05.337645 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 431/863] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:05 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:35:05.470125 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-861bbb4b-0cdb-44d0-844f-da1a2da7c6a0 req-44de884f-393a-4ae1-9661-f622e016cfe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1720981e-6170-4ee8-b78c-8ecc7b7e3383", "name": "network-vif-deleted", "tag": "21a8ef86-9f54-4c01-abcd-c55fd2b5049c"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:35:05.472252 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:35:05.472252 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:35:05.480477 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-861bbb4b-0cdb-44d0-844f-da1a2da7c6a0 req-44de884f-393a-4ae1-9661-f622e016cfe3 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:05.480919 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-861bbb4b-0cdb-44d0-844f-da1a2da7c6a0 req-44de884f-393a-4ae1-9661-f622e016cfe3 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:05.492991 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-861bbb4b-0cdb-44d0-844f-da1a2da7c6a0 req-44de884f-393a-4ae1-9661-f622e016cfe3 service nova] Creating event network-vif-deleted:21a8ef86-9f54-4c01-abcd-c55fd2b5049c for instance 1720981e-6170-4ee8-b78c-8ecc7b7e3383 on hv-cinder-81115 Nov 16 00:35:05.498221 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-861bbb4b-0cdb-44d0-844f-da1a2da7c6a0 req-44de884f-393a-4ae1-9661-f622e016cfe3 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031960 Nov 16 00:35:05.498930 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 433/864] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:35:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:35:06.221501 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-6bfecdc2-f7b5-4b50-988b-98f1143f5488 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:06.222282 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-6bfecdc2-f7b5-4b50-988b-98f1143f5488 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:06.228806 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6bfecdc2-f7b5-4b50-988b-98f1143f5488 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:06.229250 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6bfecdc2-f7b5-4b50-988b-98f1143f5488 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:06.230025 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6bfecdc2-f7b5-4b50-988b-98f1143f5488 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:06.230451 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6bfecdc2-f7b5-4b50-988b-98f1143f5488 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:06.244409 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-6bfecdc2-f7b5-4b50-988b-98f1143f5488 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] HTTP exception thrown: Instance 1720981e-6170-4ee8-b78c-8ecc7b7e3383 could not be found. Nov 16 00:35:06.245015 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-6bfecdc2-f7b5-4b50-988b-98f1143f5488 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Returning 404 to user: Instance 1720981e-6170-4ee8-b78c-8ecc7b7e3383 could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:35:06.245821 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-6bfecdc2-f7b5-4b50-988b-98f1143f5488 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383" status: 404 len: 111 microversion: 2.1 time: 0.028343 Nov 16 00:35:06.246552 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 432/865] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:06 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:35:06.255682 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-9dcfb983-993c-4853-a18b-ee1f71d49ea1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '.version_select at 0x7f2f29619700>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:06.273296 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-9dcfb983-993c-4853-a18b-ee1f71d49ea1 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-303541076" status: 202 len: 0 microversion: 2.1 time: 0.022085 Nov 16 00:35:06.273861 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 434/866] 10.222.0.31 () {58 vars in 1217 bytes} [Tue Nov 16 00:35:06 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-303541076 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:35:06.355726 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-ef0f0369-f3a9-472a-94a8-ae3ee8c60389 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:06.356630 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-ef0f0369-f3a9-472a-94a8-ae3ee8c60389 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:06.363213 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ef0f0369-f3a9-472a-94a8-ae3ee8c60389 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:06.363905 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ef0f0369-f3a9-472a-94a8-ae3ee8c60389 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:06.364857 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ef0f0369-f3a9-472a-94a8-ae3ee8c60389 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:06.365447 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ef0f0369-f3a9-472a-94a8-ae3ee8c60389 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:06.557605 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-ef0f0369-f3a9-472a-94a8-ae3ee8c60389 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:06.566500 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-ef0f0369-f3a9-472a-94a8-ae3ee8c60389 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:06.569060 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-ef0f0369-f3a9-472a-94a8-ae3ee8c60389 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:06.570480 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-ef0f0369-f3a9-472a-94a8-ae3ee8c60389 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1744 microversion: 2.20 time: 0.218456 Nov 16 00:35:06.581864 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 433/867] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:06 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1744 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:07.588684 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-e2369570-4c8b-4a90-9b4a-2bc3aa6ab527 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:07.589464 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-e2369570-4c8b-4a90-9b4a-2bc3aa6ab527 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:07.596544 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e2369570-4c8b-4a90-9b4a-2bc3aa6ab527 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:07.596987 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e2369570-4c8b-4a90-9b4a-2bc3aa6ab527 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:07.597761 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e2369570-4c8b-4a90-9b4a-2bc3aa6ab527 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:07.598371 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e2369570-4c8b-4a90-9b4a-2bc3aa6ab527 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:07.763468 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e2369570-4c8b-4a90-9b4a-2bc3aa6ab527 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:07.772047 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e2369570-4c8b-4a90-9b4a-2bc3aa6ab527 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:07.776190 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e2369570-4c8b-4a90-9b4a-2bc3aa6ab527 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:07.777731 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-e2369570-4c8b-4a90-9b4a-2bc3aa6ab527 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1739 microversion: 2.20 time: 0.192619 Nov 16 00:35:07.778634 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 435/868] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:07 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:08.635716 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-3429d80f-7ae7-40ac-b71d-c2252e9f3043 req-765ce85e-4612-44da-9a36-8f6ace893f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cabac73-4f43-4f58-941d-fcde21d2fdf2", "name": "network-vif-plugged", "status": "completed", "tag": "24c138f4-ee49-4e30-8553-2bc8c5029b8d"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:35:08.638170 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:35:08.638170 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:35:08.647147 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-3429d80f-7ae7-40ac-b71d-c2252e9f3043 req-765ce85e-4612-44da-9a36-8f6ace893f8d service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:08.647900 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-3429d80f-7ae7-40ac-b71d-c2252e9f3043 req-765ce85e-4612-44da-9a36-8f6ace893f8d service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:08.669420 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-3429d80f-7ae7-40ac-b71d-c2252e9f3043 req-765ce85e-4612-44da-9a36-8f6ace893f8d service nova] Creating event network-vif-plugged:24c138f4-ee49-4e30-8553-2bc8c5029b8d for instance 5cabac73-4f43-4f58-941d-fcde21d2fdf2 on hv-cinder-81115 Nov 16 00:35:08.679761 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-3429d80f-7ae7-40ac-b71d-c2252e9f3043 req-765ce85e-4612-44da-9a36-8f6ace893f8d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122281 Nov 16 00:35:08.684511 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 434/869] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:35:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:35:08.797924 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-a6000aa6-5e3c-49fc-963f-0800a0b7ae71 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:08.800085 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-a6000aa6-5e3c-49fc-963f-0800a0b7ae71 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:08.807287 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a6000aa6-5e3c-49fc-963f-0800a0b7ae71 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:08.808069 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a6000aa6-5e3c-49fc-963f-0800a0b7ae71 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:08.809091 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a6000aa6-5e3c-49fc-963f-0800a0b7ae71 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:08.809724 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a6000aa6-5e3c-49fc-963f-0800a0b7ae71 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:08.940134 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-a6000aa6-5e3c-49fc-963f-0800a0b7ae71 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:08.948932 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-a6000aa6-5e3c-49fc-963f-0800a0b7ae71 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:08.950401 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-a6000aa6-5e3c-49fc-963f-0800a0b7ae71 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:08.951582 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-a6000aa6-5e3c-49fc-963f-0800a0b7ae71 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1739 microversion: 2.20 time: 0.157972 Nov 16 00:35:08.952584 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 436/870] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:08 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:09.491768 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-456d60cb-7889-4075-a562-e0ab20376826 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:09.492675 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-456d60cb-7889-4075-a562-e0ab20376826 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:09.499524 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-456d60cb-7889-4075-a562-e0ab20376826 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:09.500209 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-456d60cb-7889-4075-a562-e0ab20376826 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:09.501157 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-456d60cb-7889-4075-a562-e0ab20376826 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:09.502492 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-456d60cb-7889-4075-a562-e0ab20376826 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:09.516604 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-456d60cb-7889-4075-a562-e0ab20376826 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] HTTP exception thrown: Instance 1720981e-6170-4ee8-b78c-8ecc7b7e3383 could not be found. Nov 16 00:35:09.517499 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-456d60cb-7889-4075-a562-e0ab20376826 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Returning 404 to user: Instance 1720981e-6170-4ee8-b78c-8ecc7b7e3383 could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:35:09.518510 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-456d60cb-7889-4075-a562-e0ab20376826 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "DELETE /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383" status: 404 len: 111 microversion: 2.1 time: 0.033325 Nov 16 00:35:09.522088 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 435/871] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:35:09 2021] DELETE /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:35:09.527098 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1c89baf4-d569-4117-8791-389b3f6a60cc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:09.527669 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1c89baf4-d569-4117-8791-389b3f6a60cc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: 1720981e-6170-4ee8-b78c-8ecc7b7e3383] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:09.537068 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1c89baf4-d569-4117-8791-389b3f6a60cc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:09.537672 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1c89baf4-d569-4117-8791-389b3f6a60cc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:09.538957 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1c89baf4-d569-4117-8791-389b3f6a60cc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:09.540022 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1c89baf4-d569-4117-8791-389b3f6a60cc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:09.569070 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-1c89baf4-d569-4117-8791-389b3f6a60cc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] HTTP exception thrown: Instance 1720981e-6170-4ee8-b78c-8ecc7b7e3383 could not be found. Nov 16 00:35:09.569676 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1c89baf4-d569-4117-8791-389b3f6a60cc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Returning 404 to user: Instance 1720981e-6170-4ee8-b78c-8ecc7b7e3383 could not be found. {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:35:09.570529 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-1c89baf4-d569-4117-8791-389b3f6a60cc tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383" status: 404 len: 111 microversion: 2.1 time: 0.047183 Nov 16 00:35:09.571431 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 437/872] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:09 2021] GET /compute/v2.1/servers/1720981e-6170-4ee8-b78c-8ecc7b7e3383 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:35:09.972055 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-830c01ad-4882-4ba4-9558-2076a595cf80 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:09.972807 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-830c01ad-4882-4ba4-9558-2076a595cf80 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:09.980111 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-830c01ad-4882-4ba4-9558-2076a595cf80 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:09.980429 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-830c01ad-4882-4ba4-9558-2076a595cf80 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:09.987750 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-830c01ad-4882-4ba4-9558-2076a595cf80 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:09.988652 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-830c01ad-4882-4ba4-9558-2076a595cf80 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:10.163978 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-830c01ad-4882-4ba4-9558-2076a595cf80 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:10.178501 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-830c01ad-4882-4ba4-9558-2076a595cf80 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:10.183476 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-830c01ad-4882-4ba4-9558-2076a595cf80 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:10.188422 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-830c01ad-4882-4ba4-9558-2076a595cf80 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1739 microversion: 2.20 time: 0.221182 Nov 16 00:35:10.189510 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 436/873] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:09 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:10.732460 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-827ab9c6-7b2c-488a-8045-9ef34b4c83be tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:10.733678 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-827ab9c6-7b2c-488a-8045-9ef34b4c83be tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:10.742047 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-827ab9c6-7b2c-488a-8045-9ef34b4c83be tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:10.742588 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-827ab9c6-7b2c-488a-8045-9ef34b4c83be tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:10.743655 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-827ab9c6-7b2c-488a-8045-9ef34b4c83be tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:10.744313 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-827ab9c6-7b2c-488a-8045-9ef34b4c83be tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:10.771615 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-827ab9c6-7b2c-488a-8045-9ef34b4c83be tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] HTTP exception thrown: Instance d6f376e4-af26-4799-9127-58d9efd50cdc could not be found. Nov 16 00:35:10.773222 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-827ab9c6-7b2c-488a-8045-9ef34b4c83be tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Returning 404 to user: Instance d6f376e4-af26-4799-9127-58d9efd50cdc could not be found. {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:35:10.774610 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-827ab9c6-7b2c-488a-8045-9ef34b4c83be tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 404 len: 111 microversion: 2.1 time: 0.046389 Nov 16 00:35:10.775687 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 438/874] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:35:10 2021] DELETE /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:35:10.783778 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-37dc28e4-b8f1-4fff-a92b-7b1add216fd7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:10.784655 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-37dc28e4-b8f1-4fff-a92b-7b1add216fd7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] [instance: d6f376e4-af26-4799-9127-58d9efd50cdc] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:10.793818 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-37dc28e4-b8f1-4fff-a92b-7b1add216fd7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:10.794582 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-37dc28e4-b8f1-4fff-a92b-7b1add216fd7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:10.795635 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-37dc28e4-b8f1-4fff-a92b-7b1add216fd7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:10.796254 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-37dc28e4-b8f1-4fff-a92b-7b1add216fd7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:10.812951 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-37dc28e4-b8f1-4fff-a92b-7b1add216fd7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] HTTP exception thrown: Instance d6f376e4-af26-4799-9127-58d9efd50cdc could not be found. Nov 16 00:35:10.813576 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-37dc28e4-b8f1-4fff-a92b-7b1add216fd7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] Returning 404 to user: Instance d6f376e4-af26-4799-9127-58d9efd50cdc could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:35:10.814912 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-37dc28e4-b8f1-4fff-a92b-7b1add216fd7 tempest-AttachVolumeTestJSON-2051232536 tempest-AttachVolumeTestJSON-2051232536-project] 10.222.0.31 "GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc" status: 404 len: 111 microversion: 2.1 time: 0.035258 Nov 16 00:35:10.815974 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 437/875] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:10 2021] GET /compute/v2.1/servers/d6f376e4-af26-4799-9127-58d9efd50cdc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:35:11.209005 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-2c31033a-7c3c-43ae-be84-07d4948ca28e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:11.209825 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-2c31033a-7c3c-43ae-be84-07d4948ca28e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:11.216497 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2c31033a-7c3c-43ae-be84-07d4948ca28e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:11.221568 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2c31033a-7c3c-43ae-be84-07d4948ca28e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:11.223881 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2c31033a-7c3c-43ae-be84-07d4948ca28e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:11.224325 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2c31033a-7c3c-43ae-be84-07d4948ca28e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:11.405279 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2c31033a-7c3c-43ae-be84-07d4948ca28e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:11.415756 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2c31033a-7c3c-43ae-be84-07d4948ca28e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:11.417852 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2c31033a-7c3c-43ae-be84-07d4948ca28e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:11.420479 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-2c31033a-7c3c-43ae-be84-07d4948ca28e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1739 microversion: 2.20 time: 0.216748 Nov 16 00:35:11.424118 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 439/876] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:11 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:12.441250 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d0bb0227-f30f-4925-8ea4-6b236c9d6494 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:12.442071 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d0bb0227-f30f-4925-8ea4-6b236c9d6494 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:12.452852 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d0bb0227-f30f-4925-8ea4-6b236c9d6494 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:12.453439 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d0bb0227-f30f-4925-8ea4-6b236c9d6494 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:12.454366 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d0bb0227-f30f-4925-8ea4-6b236c9d6494 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:12.456772 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d0bb0227-f30f-4925-8ea4-6b236c9d6494 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:13.074771 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d0bb0227-f30f-4925-8ea4-6b236c9d6494 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:13.085828 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d0bb0227-f30f-4925-8ea4-6b236c9d6494 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:13.088007 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d0bb0227-f30f-4925-8ea4-6b236c9d6494 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:13.089828 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d0bb0227-f30f-4925-8ea4-6b236c9d6494 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1739 microversion: 2.20 time: 0.652619 Nov 16 00:35:13.102779 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 438/877] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:12 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1739 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:14.109166 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-41bf0e48-d272-467a-a46c-fbc568417c3d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:14.110459 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-41bf0e48-d272-467a-a46c-fbc568417c3d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:14.117979 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-41bf0e48-d272-467a-a46c-fbc568417c3d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:14.118712 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-41bf0e48-d272-467a-a46c-fbc568417c3d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:14.119724 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-41bf0e48-d272-467a-a46c-fbc568417c3d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:14.120570 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-41bf0e48-d272-467a-a46c-fbc568417c3d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:14.586502 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-41bf0e48-d272-467a-a46c-fbc568417c3d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:14.594589 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-41bf0e48-d272-467a-a46c-fbc568417c3d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:14.596670 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-41bf0e48-d272-467a-a46c-fbc568417c3d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:14.597837 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-41bf0e48-d272-467a-a46c-fbc568417c3d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1739 microversion: 2.20 time: 0.492753 Nov 16 00:35:14.608401 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 440/878] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:14 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1739 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:15.615585 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-cc18af11-d9ae-4373-8072-5a94f1a3a8c4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:15.616752 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-cc18af11-d9ae-4373-8072-5a94f1a3a8c4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:15.622818 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cc18af11-d9ae-4373-8072-5a94f1a3a8c4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:15.623399 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-d573ea40-25fe-4953-8f8f-6f7545aaf296 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-650356140", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1578337872", "security_groups": [{"name": "tempest-secgroup-smoke-1129696708"}], "networks": [{"uuid": "b0799e9f-bf39-4d36-9463-c7bb236f55b4"}], "block_device_mapping_v2": [{"uuid": "275580d1-ce11-42a2-b41a-ca5375e896d9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:35:15.624058 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cc18af11-d9ae-4373-8072-5a94f1a3a8c4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:15.625069 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cc18af11-d9ae-4373-8072-5a94f1a3a8c4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:15.625710 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cc18af11-d9ae-4373-8072-5a94f1a3a8c4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:15.785494 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.network.neutron [None req-d573ea40-25fe-4953-8f8f-6f7545aaf296 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] validate_networks() for [('b0799e9f-bf39-4d36-9463-c7bb236f55b4', None, None, None, None, None)] {{(pid=122543) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:35:15.857014 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-cc18af11-d9ae-4373-8072-5a94f1a3a8c4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:15.865525 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-cc18af11-d9ae-4373-8072-5a94f1a3a8c4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:15.867009 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-cc18af11-d9ae-4373-8072-5a94f1a3a8c4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:15.868195 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-cc18af11-d9ae-4373-8072-5a94f1a3a8c4 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1739 microversion: 2.20 time: 0.256412 Nov 16 00:35:15.872025 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 439/879] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:15 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1739 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:16.386762 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-d573ea40-25fe-4953-8f8f-6f7545aaf296 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Flavor limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:35:16.387237 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-d573ea40-25fe-4953-8f8f-6f7545aaf296 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Image limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:35:16.387925 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-d573ea40-25fe-4953-8f8f-6f7545aaf296 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Flavor pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:35:16.388447 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-d573ea40-25fe-4953-8f8f-6f7545aaf296 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Image pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:35:16.389163 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-d573ea40-25fe-4953-8f8f-6f7545aaf296 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:35:16.401257 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d573ea40-25fe-4953-8f8f-6f7545aaf296 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:16.401696 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d573ea40-25fe-4953-8f8f-6f7545aaf296 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:16.402485 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d573ea40-25fe-4953-8f8f-6f7545aaf296 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:16.402907 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d573ea40-25fe-4953-8f8f-6f7545aaf296 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:16.422425 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-d573ea40-25fe-4953-8f8f-6f7545aaf296 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Getting quotas for project 8b1da70dc7334be3be9b115125527150. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:35:16.427506 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-d573ea40-25fe-4953-8f8f-6f7545aaf296 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Getting quotas for user 456426d38d9c4cd3be59d047a845d8b5 and project 8b1da70dc7334be3be9b115125527150. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:35:16.542974 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d573ea40-25fe-4953-8f8f-6f7545aaf296 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Going to run 1 instances... {{(pid=122543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:35:16.545634 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d573ea40-25fe-4953-8f8f-6f7545aaf296 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='275580d1-ce11-42a2-b41a-ca5375e896d9',volume_size=None,volume_type=None)] {{(pid=122543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:35:16.723262 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-d573ea40-25fe-4953-8f8f-6f7545aaf296 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.103346 Nov 16 00:35:16.725786 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 441/880] 10.222.0.31 () {60 vars in 1146 bytes} [Tue Nov 16 00:35:15 2021] POST /compute/v2.1/servers => generated 406 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 16 00:35:16.736650 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-641ce4b7-511f-47e6-8b77-ead710be3f6c tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:16.737791 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-641ce4b7-511f-47e6-8b77-ead710be3f6c tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:16.838766 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-641ce4b7-511f-47e6-8b77-ead710be3f6c tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:16.846564 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-641ce4b7-511f-47e6-8b77-ead710be3f6c tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1088 microversion: 2.1 time: 0.114409 Nov 16 00:35:16.847510 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 440/881] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:16 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1088 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:16.886267 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-baed54f8-9b15-4951-88a0-626da6acc02c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:16.887342 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-baed54f8-9b15-4951-88a0-626da6acc02c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:16.894935 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-baed54f8-9b15-4951-88a0-626da6acc02c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:16.895412 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-baed54f8-9b15-4951-88a0-626da6acc02c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:16.896213 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-baed54f8-9b15-4951-88a0-626da6acc02c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:16.896741 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-baed54f8-9b15-4951-88a0-626da6acc02c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:17.105835 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-baed54f8-9b15-4951-88a0-626da6acc02c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:17.114318 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-baed54f8-9b15-4951-88a0-626da6acc02c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:17.115918 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-baed54f8-9b15-4951-88a0-626da6acc02c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:17.117392 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-baed54f8-9b15-4951-88a0-626da6acc02c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1739 microversion: 2.20 time: 0.235240 Nov 16 00:35:17.118501 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 442/882] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:16 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:35:17.864672 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-1e94837c-acd4-4b65-a103-9c77228cb8be tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:17.865931 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-1e94837c-acd4-4b65-a103-9c77228cb8be tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:17.875335 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1e94837c-acd4-4b65-a103-9c77228cb8be tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:17.876096 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1e94837c-acd4-4b65-a103-9c77228cb8be tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:17.882915 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1e94837c-acd4-4b65-a103-9c77228cb8be tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:17.883541 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1e94837c-acd4-4b65-a103-9c77228cb8be tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:18.053001 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-1e94837c-acd4-4b65-a103-9c77228cb8be tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:18.066437 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-1e94837c-acd4-4b65-a103-9c77228cb8be tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1186 microversion: 2.1 time: 0.205630 Nov 16 00:35:18.067937 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 441/883] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:17 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1186 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:18.135958 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-307b859b-f3bd-4ce0-92db-bc28723e219c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:18.137745 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-307b859b-f3bd-4ce0-92db-bc28723e219c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:18.148038 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-307b859b-f3bd-4ce0-92db-bc28723e219c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:18.148826 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-307b859b-f3bd-4ce0-92db-bc28723e219c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:18.149792 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-307b859b-f3bd-4ce0-92db-bc28723e219c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:18.150381 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-307b859b-f3bd-4ce0-92db-bc28723e219c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:18.438768 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-307b859b-f3bd-4ce0-92db-bc28723e219c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:18.453601 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-307b859b-f3bd-4ce0-92db-bc28723e219c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:18.457549 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-307b859b-f3bd-4ce0-92db-bc28723e219c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:18.459068 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-307b859b-f3bd-4ce0-92db-bc28723e219c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1739 microversion: 2.20 time: 0.326716 Nov 16 00:35:18.459823 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 443/884] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:18 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1739 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:18.530361 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-54355e8a-adb1-4c06-a8d6-157b1c354ca3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1699485130", "imageRef": "bb47ca05-3b48-4f1c-bc96-e0c5c672caba", "flavorRef": "452", "networks": [{"uuid": "3ade04b1-2f01-4769-9a91-0d2df635fcbb"}]}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:35:18.583267 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.network.neutron [None req-54355e8a-adb1-4c06-a8d6-157b1c354ca3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] validate_networks() for [('3ade04b1-2f01-4769-9a91-0d2df635fcbb', None, None, None, None, None)] {{(pid=122544) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:35:19.001863 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-54355e8a-adb1-4c06-a8d6-157b1c354ca3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Flavor limits 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:35:19.002506 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-54355e8a-adb1-4c06-a8d6-157b1c354ca3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Image limits 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:35:19.002732 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-54355e8a-adb1-4c06-a8d6-157b1c354ca3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Flavor pref 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:35:19.003177 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-54355e8a-adb1-4c06-a8d6-157b1c354ca3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Image pref 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:35:19.004467 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-54355e8a-adb1-4c06-a8d6-157b1c354ca3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:35:19.013089 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-54355e8a-adb1-4c06-a8d6-157b1c354ca3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:19.013573 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-54355e8a-adb1-4c06-a8d6-157b1c354ca3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:19.014348 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-54355e8a-adb1-4c06-a8d6-157b1c354ca3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:19.014690 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-54355e8a-adb1-4c06-a8d6-157b1c354ca3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:19.031461 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-54355e8a-adb1-4c06-a8d6-157b1c354ca3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Getting quotas for project 1b08090244b44b94bdedacad6778dec0. Resources: {'instances', 'cores', 'ram'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:35:19.036829 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-54355e8a-adb1-4c06-a8d6-157b1c354ca3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Getting quotas for user facd3c2e165f495c86342ba380ca5d3b and project 1b08090244b44b94bdedacad6778dec0. Resources: {'instances', 'cores', 'ram'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:35:19.048731 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-54355e8a-adb1-4c06-a8d6-157b1c354ca3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Going to run 1 instances... {{(pid=122544) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:35:19.051073 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-54355e8a-adb1-4c06-a8d6-157b1c354ca3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb47ca05-3b48-4f1c-bc96-e0c5c672caba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:35:19.084846 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1fe63965-8e95-4fa0-ab1b-effa9fb1aaaa tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:19.085385 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1fe63965-8e95-4fa0-ab1b-effa9fb1aaaa tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:19.091244 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1fe63965-8e95-4fa0-ab1b-effa9fb1aaaa tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:19.091905 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1fe63965-8e95-4fa0-ab1b-effa9fb1aaaa tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:19.092869 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1fe63965-8e95-4fa0-ab1b-effa9fb1aaaa tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:19.093456 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1fe63965-8e95-4fa0-ab1b-effa9fb1aaaa tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:19.102932 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-54355e8a-adb1-4c06-a8d6-157b1c354ca3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707943 Nov 16 00:35:19.108465 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 442/885] 10.222.0.31 () {60 vars in 1146 bytes} [Tue Nov 16 00:35:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 00:35:19.114556 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a1bab494-1bcc-403d-953d-331224751fc0 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:19.115504 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a1bab494-1bcc-403d-953d-331224751fc0 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:19.190643 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a1bab494-1bcc-403d-953d-331224751fc0 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:19.197834 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a1bab494-1bcc-403d-953d-331224751fc0 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1218 microversion: 2.1 time: 0.087711 Nov 16 00:35:19.198183 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 443/886] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:19 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:19.243075 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-1fe63965-8e95-4fa0-ab1b-effa9fb1aaaa tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:19.250925 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-1fe63965-8e95-4fa0-ab1b-effa9fb1aaaa tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1272 microversion: 2.1 time: 0.169853 Nov 16 00:35:19.251651 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 444/887] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:19 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1272 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:19.478193 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-9b3e1a3f-7246-42b7-a720-be6858c915d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:19.478719 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-9b3e1a3f-7246-42b7-a720-be6858c915d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:19.485253 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9b3e1a3f-7246-42b7-a720-be6858c915d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:19.485990 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9b3e1a3f-7246-42b7-a720-be6858c915d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:19.486806 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9b3e1a3f-7246-42b7-a720-be6858c915d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:19.487265 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9b3e1a3f-7246-42b7-a720-be6858c915d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:19.619676 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-9b3e1a3f-7246-42b7-a720-be6858c915d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:19.628664 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-9b3e1a3f-7246-42b7-a720-be6858c915d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:19.630331 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-9b3e1a3f-7246-42b7-a720-be6858c915d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:19.631658 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-9b3e1a3f-7246-42b7-a720-be6858c915d5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1739 microversion: 2.20 time: 0.157571 Nov 16 00:35:19.632216 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 444/888] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:19 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:20.215144 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-41a0b434-548f-4c61-a0fd-0762d9a88e86 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:20.215774 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-41a0b434-548f-4c61-a0fd-0762d9a88e86 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:20.222731 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-41a0b434-548f-4c61-a0fd-0762d9a88e86 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:20.223213 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-41a0b434-548f-4c61-a0fd-0762d9a88e86 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:20.223978 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-41a0b434-548f-4c61-a0fd-0762d9a88e86 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:20.224408 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-41a0b434-548f-4c61-a0fd-0762d9a88e86 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:20.267487 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-120cd5ba-19f8-43a5-8946-4fc71be09a7d tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:20.268074 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-120cd5ba-19f8-43a5-8946-4fc71be09a7d tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:20.274270 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-120cd5ba-19f8-43a5-8946-4fc71be09a7d tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:20.274719 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-120cd5ba-19f8-43a5-8946-4fc71be09a7d tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:20.275568 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-120cd5ba-19f8-43a5-8946-4fc71be09a7d tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:20.275997 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-120cd5ba-19f8-43a5-8946-4fc71be09a7d tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:20.283593 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-41a0b434-548f-4c61-a0fd-0762d9a88e86 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:20.290879 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-41a0b434-548f-4c61-a0fd-0762d9a88e86 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1222 microversion: 2.1 time: 0.079427 Nov 16 00:35:20.291694 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 445/889] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:20 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:20.398226 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-120cd5ba-19f8-43a5-8946-4fc71be09a7d tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:20.405454 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-120cd5ba-19f8-43a5-8946-4fc71be09a7d tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1272 microversion: 2.1 time: 0.141654 Nov 16 00:35:20.406017 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 445/890] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:20 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1272 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:20.651956 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-4034ad3c-4c8b-4afe-878c-729063963c4a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:20.652443 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-4034ad3c-4c8b-4afe-878c-729063963c4a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:20.659539 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4034ad3c-4c8b-4afe-878c-729063963c4a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:20.660245 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4034ad3c-4c8b-4afe-878c-729063963c4a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:20.661029 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4034ad3c-4c8b-4afe-878c-729063963c4a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:20.661464 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-4034ad3c-4c8b-4afe-878c-729063963c4a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:20.788208 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-4034ad3c-4c8b-4afe-878c-729063963c4a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:20.795998 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-4034ad3c-4c8b-4afe-878c-729063963c4a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:20.797556 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-4034ad3c-4c8b-4afe-878c-729063963c4a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:20.799393 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-4034ad3c-4c8b-4afe-878c-729063963c4a tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1739 microversion: 2.20 time: 0.151449 Nov 16 00:35:20.799956 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 446/891] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:20 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:21.308926 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-350ea7e2-1911-4adc-bcab-1bc5a73eaf47 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:21.309972 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-350ea7e2-1911-4adc-bcab-1bc5a73eaf47 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:21.316244 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-350ea7e2-1911-4adc-bcab-1bc5a73eaf47 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:21.316679 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-350ea7e2-1911-4adc-bcab-1bc5a73eaf47 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:21.317441 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-350ea7e2-1911-4adc-bcab-1bc5a73eaf47 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:21.317864 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-350ea7e2-1911-4adc-bcab-1bc5a73eaf47 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:21.391698 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-350ea7e2-1911-4adc-bcab-1bc5a73eaf47 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:21.400089 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-350ea7e2-1911-4adc-bcab-1bc5a73eaf47 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1270 microversion: 2.1 time: 0.095516 Nov 16 00:35:21.400968 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 446/892] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:21 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:21.429700 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-873474be-3403-4edb-9150-96f6c884e8a0 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:21.430317 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-873474be-3403-4edb-9150-96f6c884e8a0 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:21.439835 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-873474be-3403-4edb-9150-96f6c884e8a0 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:21.440282 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-873474be-3403-4edb-9150-96f6c884e8a0 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:21.444106 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-873474be-3403-4edb-9150-96f6c884e8a0 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:21.444835 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-873474be-3403-4edb-9150-96f6c884e8a0 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:21.693664 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-6b9fcc3b-0ba1-42c1-808f-918c48be2c2d req-a1b81477-c7b8-404a-b8b7-2a1723892029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d2b3498-9dc0-415d-8e78-dee875d29a7f", "tag": "e9de811a-ed83-4234-81b8-9dda4ea6612f"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:35:21.695301 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:35:21.695301 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:35:21.706575 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-6b9fcc3b-0ba1-42c1-808f-918c48be2c2d req-a1b81477-c7b8-404a-b8b7-2a1723892029 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:21.709733 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-6b9fcc3b-0ba1-42c1-808f-918c48be2c2d req-a1b81477-c7b8-404a-b8b7-2a1723892029 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:21.730136 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-6b9fcc3b-0ba1-42c1-808f-918c48be2c2d req-a1b81477-c7b8-404a-b8b7-2a1723892029 service nova] Creating event network-changed:e9de811a-ed83-4234-81b8-9dda4ea6612f for instance 4d2b3498-9dc0-415d-8e78-dee875d29a7f on hv-cinder-81115 Nov 16 00:35:21.738803 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-6b9fcc3b-0ba1-42c1-808f-918c48be2c2d req-a1b81477-c7b8-404a-b8b7-2a1723892029 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051240 Nov 16 00:35:21.740009 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 447/893] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:35:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:35:21.772266 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-873474be-3403-4edb-9150-96f6c884e8a0 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:21.788398 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-873474be-3403-4edb-9150-96f6c884e8a0 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1272 microversion: 2.1 time: 0.367978 Nov 16 00:35:21.798567 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 447/894] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:21 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1272 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:21.820261 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-52e5e326-2a3a-4150-b0df-f34d91259b0e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:21.820905 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-52e5e326-2a3a-4150-b0df-f34d91259b0e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:21.834237 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-52e5e326-2a3a-4150-b0df-f34d91259b0e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:21.834875 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-52e5e326-2a3a-4150-b0df-f34d91259b0e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:21.835744 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-52e5e326-2a3a-4150-b0df-f34d91259b0e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:21.836177 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-52e5e326-2a3a-4150-b0df-f34d91259b0e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:22.069258 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-52e5e326-2a3a-4150-b0df-f34d91259b0e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:22.080622 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-52e5e326-2a3a-4150-b0df-f34d91259b0e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:22.082611 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-52e5e326-2a3a-4150-b0df-f34d91259b0e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:22.083907 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-52e5e326-2a3a-4150-b0df-f34d91259b0e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1721 microversion: 2.20 time: 0.269835 Nov 16 00:35:22.094661 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 448/895] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:21 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1721 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:22.418623 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-5819dc93-cab2-4b1a-b122-91a14d47dd26 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:22.419635 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-5819dc93-cab2-4b1a-b122-91a14d47dd26 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:22.426075 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5819dc93-cab2-4b1a-b122-91a14d47dd26 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:22.426844 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5819dc93-cab2-4b1a-b122-91a14d47dd26 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:22.427927 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5819dc93-cab2-4b1a-b122-91a14d47dd26 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:22.428593 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5819dc93-cab2-4b1a-b122-91a14d47dd26 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:22.612916 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-5819dc93-cab2-4b1a-b122-91a14d47dd26 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:22.624332 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-5819dc93-cab2-4b1a-b122-91a14d47dd26 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1276 microversion: 2.1 time: 0.209661 Nov 16 00:35:22.636432 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 448/896] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:22 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1276 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:22.805616 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-91f930a7-24d6-46f4-825c-5dbdb397afb4 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:22.806315 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-91f930a7-24d6-46f4-825c-5dbdb397afb4 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:22.812387 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-91f930a7-24d6-46f4-825c-5dbdb397afb4 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:22.812820 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-91f930a7-24d6-46f4-825c-5dbdb397afb4 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:22.813584 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-91f930a7-24d6-46f4-825c-5dbdb397afb4 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:22.814001 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-91f930a7-24d6-46f4-825c-5dbdb397afb4 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:22.987217 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-91f930a7-24d6-46f4-825c-5dbdb397afb4 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:22.995266 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-91f930a7-24d6-46f4-825c-5dbdb397afb4 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1260 microversion: 2.1 time: 0.193433 Nov 16 00:35:22.995866 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 449/897] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:22 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:23.102511 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-2cb9c062-372c-459e-9d0a-ca4a88075c06 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:23.103157 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-2cb9c062-372c-459e-9d0a-ca4a88075c06 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:23.109505 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2cb9c062-372c-459e-9d0a-ca4a88075c06 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:23.109953 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2cb9c062-372c-459e-9d0a-ca4a88075c06 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:23.110795 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2cb9c062-372c-459e-9d0a-ca4a88075c06 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:23.111359 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2cb9c062-372c-459e-9d0a-ca4a88075c06 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:23.317054 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2cb9c062-372c-459e-9d0a-ca4a88075c06 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:23.330576 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2cb9c062-372c-459e-9d0a-ca4a88075c06 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:23.332263 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2cb9c062-372c-459e-9d0a-ca4a88075c06 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:23.333420 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-2cb9c062-372c-459e-9d0a-ca4a88075c06 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1721 microversion: 2.20 time: 0.234827 Nov 16 00:35:23.333985 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 449/898] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:23 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:23.643604 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d8e3ca8a-1556-43d6-b55c-fe38506a4540 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:23.644251 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d8e3ca8a-1556-43d6-b55c-fe38506a4540 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:23.650249 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d8e3ca8a-1556-43d6-b55c-fe38506a4540 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:23.650692 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d8e3ca8a-1556-43d6-b55c-fe38506a4540 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:23.651503 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d8e3ca8a-1556-43d6-b55c-fe38506a4540 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:23.651932 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d8e3ca8a-1556-43d6-b55c-fe38506a4540 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:23.768938 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-3499dd67-c322-4821-9c44-babdfefac869 req-ad97ff74-5c73-4f40-aa1e-aa78d6cc26b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f7f9627-db3b-428d-819b-5c5c59084942", "tag": "13925c20-f053-442a-8124-fd021f837b58"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:35:23.770572 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:35:23.770572 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:35:23.778335 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-3499dd67-c322-4821-9c44-babdfefac869 req-ad97ff74-5c73-4f40-aa1e-aa78d6cc26b7 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:23.778779 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-3499dd67-c322-4821-9c44-babdfefac869 req-ad97ff74-5c73-4f40-aa1e-aa78d6cc26b7 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:23.790591 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d8e3ca8a-1556-43d6-b55c-fe38506a4540 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:23.790998 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-3499dd67-c322-4821-9c44-babdfefac869 req-ad97ff74-5c73-4f40-aa1e-aa78d6cc26b7 service nova] Creating event network-changed:13925c20-f053-442a-8124-fd021f837b58 for instance 2f7f9627-db3b-428d-819b-5c5c59084942 on hv-cinder-81115 Nov 16 00:35:23.799304 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d8e3ca8a-1556-43d6-b55c-fe38506a4540 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1318 microversion: 2.1 time: 0.159146 Nov 16 00:35:23.802209 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-3499dd67-c322-4821-9c44-babdfefac869 req-ad97ff74-5c73-4f40-aa1e-aa78d6cc26b7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037020 Nov 16 00:35:23.804346 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 450/899] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:35:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:35:23.804772 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 450/900] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:23 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:24.011862 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c80b114e-4999-4fa6-8843-26ce6b345a31 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:24.012682 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c80b114e-4999-4fa6-8843-26ce6b345a31 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:24.018847 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c80b114e-4999-4fa6-8843-26ce6b345a31 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:24.019336 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c80b114e-4999-4fa6-8843-26ce6b345a31 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:24.020106 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c80b114e-4999-4fa6-8843-26ce6b345a31 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:24.020527 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c80b114e-4999-4fa6-8843-26ce6b345a31 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:24.229214 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c80b114e-4999-4fa6-8843-26ce6b345a31 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:24.237661 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c80b114e-4999-4fa6-8843-26ce6b345a31 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1260 microversion: 2.1 time: 0.229616 Nov 16 00:35:24.238428 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 451/901] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:24 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:24.352269 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-52098747-5fc9-49a1-977a-4be9d6284e67 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:24.352997 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-52098747-5fc9-49a1-977a-4be9d6284e67 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:24.359462 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-52098747-5fc9-49a1-977a-4be9d6284e67 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:24.360000 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-52098747-5fc9-49a1-977a-4be9d6284e67 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:24.361151 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-52098747-5fc9-49a1-977a-4be9d6284e67 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:24.361943 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-52098747-5fc9-49a1-977a-4be9d6284e67 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:24.508438 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-52098747-5fc9-49a1-977a-4be9d6284e67 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:24.518183 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-52098747-5fc9-49a1-977a-4be9d6284e67 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:24.521353 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-52098747-5fc9-49a1-977a-4be9d6284e67 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:24.522809 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-52098747-5fc9-49a1-977a-4be9d6284e67 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1721 microversion: 2.20 time: 0.174317 Nov 16 00:35:24.523904 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 451/902] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:24 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:24.540459 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-f41a35b9-5454-4f7a-8ced-1456da0ba859 req-81af290a-b683-4674-abf7-647dbdb5d46b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cabac73-4f43-4f58-941d-fcde21d2fdf2", "name": "network-vif-unplugged", "status": "completed", "tag": "24c138f4-ee49-4e30-8553-2bc8c5029b8d"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:35:24.542200 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:35:24.542200 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:35:24.550502 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-f41a35b9-5454-4f7a-8ced-1456da0ba859 req-81af290a-b683-4674-abf7-647dbdb5d46b service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:24.551083 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-f41a35b9-5454-4f7a-8ced-1456da0ba859 req-81af290a-b683-4674-abf7-647dbdb5d46b service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:24.565871 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-f41a35b9-5454-4f7a-8ced-1456da0ba859 req-81af290a-b683-4674-abf7-647dbdb5d46b service nova] Creating event network-vif-unplugged:24c138f4-ee49-4e30-8553-2bc8c5029b8d for instance 5cabac73-4f43-4f58-941d-fcde21d2fdf2 on hv-cinder-81115 Nov 16 00:35:24.571246 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-f41a35b9-5454-4f7a-8ced-1456da0ba859 req-81af290a-b683-4674-abf7-647dbdb5d46b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034528 Nov 16 00:35:24.572191 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 452/903] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:35:24 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:35:24.768401 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-bcf984b2-1e57-467b-9241-a91aae5463ba tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1787021011", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2139507500", "security_groups": [{"name": "tempest-secgroup-smoke-1181632784"}], "block_device_mapping_v2": [{"uuid": "b86ce8f5-d2e8-4715-a0b6-4a7522c66676", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5b2f5911-2804-41c1-a851-8f21bec631b6"}]}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:35:24.817976 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-80bf082a-de96-44de-b422-6c9a274f5dd0 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:24.818655 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-80bf082a-de96-44de-b422-6c9a274f5dd0 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:24.825098 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-80bf082a-de96-44de-b422-6c9a274f5dd0 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:24.825513 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-80bf082a-de96-44de-b422-6c9a274f5dd0 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:24.826282 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-80bf082a-de96-44de-b422-6c9a274f5dd0 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:24.826704 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-80bf082a-de96-44de-b422-6c9a274f5dd0 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:24.877019 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.network.neutron [None req-bcf984b2-1e57-467b-9241-a91aae5463ba tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] validate_networks() for [('5b2f5911-2804-41c1-a851-8f21bec631b6', None, None, None, None, None)] {{(pid=122544) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:35:24.958949 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-80bf082a-de96-44de-b422-6c9a274f5dd0 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:24.967836 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-80bf082a-de96-44de-b422-6c9a274f5dd0 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1318 microversion: 2.1 time: 0.154675 Nov 16 00:35:24.978110 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 453/904] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:24 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:25.254631 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-eecbb7f1-676d-41db-91ae-ebda94d90a0c tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:25.255264 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-eecbb7f1-676d-41db-91ae-ebda94d90a0c tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:25.260941 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-eecbb7f1-676d-41db-91ae-ebda94d90a0c tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:25.261381 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-eecbb7f1-676d-41db-91ae-ebda94d90a0c tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:25.262147 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-eecbb7f1-676d-41db-91ae-ebda94d90a0c tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:25.262574 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-eecbb7f1-676d-41db-91ae-ebda94d90a0c tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:25.273456 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-bcf984b2-1e57-467b-9241-a91aae5463ba tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Flavor limits 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:35:25.273869 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-bcf984b2-1e57-467b-9241-a91aae5463ba tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Image limits 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:35:25.274338 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-bcf984b2-1e57-467b-9241-a91aae5463ba tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Flavor pref 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:35:25.274739 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-bcf984b2-1e57-467b-9241-a91aae5463ba tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Image pref 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:35:25.275175 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-bcf984b2-1e57-467b-9241-a91aae5463ba tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:35:25.283815 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bcf984b2-1e57-467b-9241-a91aae5463ba tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:25.284254 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bcf984b2-1e57-467b-9241-a91aae5463ba tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:25.285320 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bcf984b2-1e57-467b-9241-a91aae5463ba tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:25.285749 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bcf984b2-1e57-467b-9241-a91aae5463ba tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:25.304393 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-bcf984b2-1e57-467b-9241-a91aae5463ba tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Getting quotas for project cce0078a151f47738c5863929c403dc7. Resources: {'instances', 'cores', 'ram'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:35:25.309600 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-bcf984b2-1e57-467b-9241-a91aae5463ba tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Getting quotas for user 5fa70de1eca24c8da180736ff9ebc553 and project cce0078a151f47738c5863929c403dc7. Resources: {'instances', 'cores', 'ram'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:35:25.377550 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-bcf984b2-1e57-467b-9241-a91aae5463ba tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Going to run 1 instances... {{(pid=122544) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:35:25.379668 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-bcf984b2-1e57-467b-9241-a91aae5463ba tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b86ce8f5-d2e8-4715-a0b6-4a7522c66676',volume_size=None,volume_type=None)] {{(pid=122544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:35:25.394972 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-eecbb7f1-676d-41db-91ae-ebda94d90a0c tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:25.402341 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-eecbb7f1-676d-41db-91ae-ebda94d90a0c tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1260 microversion: 2.1 time: 0.152465 Nov 16 00:35:25.404348 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 454/905] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:25 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:25.515618 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-bcf984b2-1e57-467b-9241-a91aae5463ba tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.751128 Nov 16 00:35:25.516627 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 452/906] 10.222.0.31 () {60 vars in 1146 bytes} [Tue Nov 16 00:35:24 2021] POST /compute/v2.1/servers => generated 406 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 00:35:25.526499 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f774ef79-aced-4832-aa50-191f38aaae5b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:25.527264 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f774ef79-aced-4832-aa50-191f38aaae5b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:25.552205 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-96c2ef4b-c572-4bad-b7cc-3e7fabb4ca7d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:25.553230 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-96c2ef4b-c572-4bad-b7cc-3e7fabb4ca7d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:25.563523 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-96c2ef4b-c572-4bad-b7cc-3e7fabb4ca7d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:25.564117 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-96c2ef4b-c572-4bad-b7cc-3e7fabb4ca7d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:25.565130 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-96c2ef4b-c572-4bad-b7cc-3e7fabb4ca7d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:25.565750 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-96c2ef4b-c572-4bad-b7cc-3e7fabb4ca7d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:25.588119 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f774ef79-aced-4832-aa50-191f38aaae5b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:25.595004 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f774ef79-aced-4832-aa50-191f38aaae5b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1095 microversion: 2.1 time: 0.072075 Nov 16 00:35:25.604596 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 455/907] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:25 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:25.696971 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-96c2ef4b-c572-4bad-b7cc-3e7fabb4ca7d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:25.704799 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-96c2ef4b-c572-4bad-b7cc-3e7fabb4ca7d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:25.706292 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-96c2ef4b-c572-4bad-b7cc-3e7fabb4ca7d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:25.707480 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-96c2ef4b-c572-4bad-b7cc-3e7fabb4ca7d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1664 microversion: 2.20 time: 0.162672 Nov 16 00:35:25.708022 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 453/908] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:25 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1664 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:25.725346 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-58265a07-3132-4011-90db-e44ca37348b8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d23c0cc2-f139-44f7-bec9-4f3b0947418d"}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:35:25.726426 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-58265a07-3132-4011-90db-e44ca37348b8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:25.732483 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-58265a07-3132-4011-90db-e44ca37348b8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:25.732726 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-58265a07-3132-4011-90db-e44ca37348b8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:25.733627 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-58265a07-3132-4011-90db-e44ca37348b8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:25.734096 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-58265a07-3132-4011-90db-e44ca37348b8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:25.985584 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-494a893b-5496-41e8-bde5-3b9f89b318a6 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:25.986242 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-494a893b-5496-41e8-bde5-3b9f89b318a6 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:25.993039 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-494a893b-5496-41e8-bde5-3b9f89b318a6 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:25.993532 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-494a893b-5496-41e8-bde5-3b9f89b318a6 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:25.994326 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-494a893b-5496-41e8-bde5-3b9f89b318a6 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:25.994782 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-494a893b-5496-41e8-bde5-3b9f89b318a6 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:26.026776 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-58265a07-3132-4011-90db-e44ca37348b8 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.305157 Nov 16 00:35:26.028211 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 456/909] 10.222.0.31 () {62 vars in 1363 bytes} [Tue Nov 16 00:35:25 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/os-volume_attachments => generated 188 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 00:35:26.133034 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-494a893b-5496-41e8-bde5-3b9f89b318a6 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:26.140625 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-494a893b-5496-41e8-bde5-3b9f89b318a6 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1318 microversion: 2.1 time: 0.159211 Nov 16 00:35:26.141425 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 454/910] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:25 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:26.170799 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-03bc608a-f843-4483-bf96-a02c0de4fb88 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:26.171583 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-03bc608a-f843-4483-bf96-a02c0de4fb88 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:26.178300 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-03bc608a-f843-4483-bf96-a02c0de4fb88 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:26.178769 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-03bc608a-f843-4483-bf96-a02c0de4fb88 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:26.179746 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-03bc608a-f843-4483-bf96-a02c0de4fb88 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:26.180347 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-03bc608a-f843-4483-bf96-a02c0de4fb88 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:26.422714 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-03bc608a-f843-4483-bf96-a02c0de4fb88 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/os-volume_attachments/d23c0cc2-f139-44f7-bec9-4f3b0947418d" status: 202 len: 0 microversion: 2.20 time: 0.255677 Nov 16 00:35:26.423127 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0181db07-ac9c-40c7-bb69-58f7831945f2 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:26.424592 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0181db07-ac9c-40c7-bb69-58f7831945f2 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:26.427261 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 457/911] 10.222.0.31 () {60 vars in 1456 bytes} [Tue Nov 16 00:35:26 2021] DELETE /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/os-volume_attachments/d23c0cc2-f139-44f7-bec9-4f3b0947418d => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 16 00:35:26.430963 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0181db07-ac9c-40c7-bb69-58f7831945f2 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:26.431482 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0181db07-ac9c-40c7-bb69-58f7831945f2 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:26.432423 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0181db07-ac9c-40c7-bb69-58f7831945f2 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:26.432866 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0181db07-ac9c-40c7-bb69-58f7831945f2 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:26.513520 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ac2127ba-053f-48c0-80a8-b027146da936 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:35:26.514427 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ac2127ba-053f-48c0-80a8-b027146da936 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:26.521973 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ac2127ba-053f-48c0-80a8-b027146da936 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:26.522727 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ac2127ba-053f-48c0-80a8-b027146da936 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:26.523725 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ac2127ba-053f-48c0-80a8-b027146da936 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:26.524319 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ac2127ba-053f-48c0-80a8-b027146da936 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:26.597796 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0181db07-ac9c-40c7-bb69-58f7831945f2 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:26.607754 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0181db07-ac9c-40c7-bb69-58f7831945f2 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1260 microversion: 2.1 time: 0.188602 Nov 16 00:35:26.608534 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 455/912] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:26 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:26.623516 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-7bca6238-4b5b-43e5-82fd-b9d6671f4a69 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:26.624382 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-7bca6238-4b5b-43e5-82fd-b9d6671f4a69 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:26.632203 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7bca6238-4b5b-43e5-82fd-b9d6671f4a69 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:26.632813 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7bca6238-4b5b-43e5-82fd-b9d6671f4a69 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:26.633794 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7bca6238-4b5b-43e5-82fd-b9d6671f4a69 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:26.634445 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7bca6238-4b5b-43e5-82fd-b9d6671f4a69 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:26.646059 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ac2127ba-053f-48c0-80a8-b027146da936 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action" status: 202 len: 0 microversion: 2.20 time: 0.136194 Nov 16 00:35:26.646667 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 458/913] 10.222.0.31 () {62 vars in 1318 bytes} [Tue Nov 16 00:35:26 2021] POST /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 16 00:35:26.660334 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-7c439209-fc95-4fdb-940d-bddb6e90ee3f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:26.661494 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-7c439209-fc95-4fdb-940d-bddb6e90ee3f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:26.670812 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7c439209-fc95-4fdb-940d-bddb6e90ee3f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:26.671575 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7c439209-fc95-4fdb-940d-bddb6e90ee3f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:26.672369 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7c439209-fc95-4fdb-940d-bddb6e90ee3f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:26.675867 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7c439209-fc95-4fdb-940d-bddb6e90ee3f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:26.737134 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-7bca6238-4b5b-43e5-82fd-b9d6671f4a69 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:26.746502 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-7bca6238-4b5b-43e5-82fd-b9d6671f4a69 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1211 microversion: 2.1 time: 0.126431 Nov 16 00:35:26.748217 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 456/914] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:26 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1211 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:26.978663 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-7c439209-fc95-4fdb-940d-bddb6e90ee3f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:26.987037 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-7c439209-fc95-4fdb-940d-bddb6e90ee3f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:26.988606 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-7c439209-fc95-4fdb-940d-bddb6e90ee3f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:26.989815 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-7c439209-fc95-4fdb-940d-bddb6e90ee3f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1672 microversion: 2.20 time: 0.338050 Nov 16 00:35:26.990352 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 459/915] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:26 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1672 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:27.161667 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0eaaa4a6-311a-4c08-9d92-8c708398b233 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:27.162674 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0eaaa4a6-311a-4c08-9d92-8c708398b233 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:27.181898 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0eaaa4a6-311a-4c08-9d92-8c708398b233 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:27.182703 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0eaaa4a6-311a-4c08-9d92-8c708398b233 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:27.183892 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0eaaa4a6-311a-4c08-9d92-8c708398b233 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:27.184680 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0eaaa4a6-311a-4c08-9d92-8c708398b233 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:27.396613 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0eaaa4a6-311a-4c08-9d92-8c708398b233 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:27.405021 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0eaaa4a6-311a-4c08-9d92-8c708398b233 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1318 microversion: 2.1 time: 0.250114 Nov 16 00:35:27.405797 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 457/916] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:27 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:27.627156 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-7fd48bff-991b-4af1-87d5-05e08b431d6f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:27.627877 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-7fd48bff-991b-4af1-87d5-05e08b431d6f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:27.634484 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7fd48bff-991b-4af1-87d5-05e08b431d6f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:27.635112 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7fd48bff-991b-4af1-87d5-05e08b431d6f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:27.635973 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7fd48bff-991b-4af1-87d5-05e08b431d6f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:27.636649 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7fd48bff-991b-4af1-87d5-05e08b431d6f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:27.765923 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-ee6a0bfa-2355-4001-9994-34318d9bfd2e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:27.766823 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-ee6a0bfa-2355-4001-9994-34318d9bfd2e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:27.776131 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ee6a0bfa-2355-4001-9994-34318d9bfd2e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:27.777161 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ee6a0bfa-2355-4001-9994-34318d9bfd2e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:27.777384 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ee6a0bfa-2355-4001-9994-34318d9bfd2e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:27.777816 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ee6a0bfa-2355-4001-9994-34318d9bfd2e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:27.878532 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-7fd48bff-991b-4af1-87d5-05e08b431d6f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:27.886809 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-7fd48bff-991b-4af1-87d5-05e08b431d6f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1260 microversion: 2.1 time: 0.264234 Nov 16 00:35:27.887861 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 460/917] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:27 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1260 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:27.916031 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-ee6a0bfa-2355-4001-9994-34318d9bfd2e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:27.923451 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-ee6a0bfa-2355-4001-9994-34318d9bfd2e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1267 microversion: 2.1 time: 0.161730 Nov 16 00:35:27.924530 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 458/918] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:27 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:28.008139 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-6d181b84-ea85-43b5-917a-e5927db1d4f7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:28.008738 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-6d181b84-ea85-43b5-917a-e5927db1d4f7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:28.014758 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6d181b84-ea85-43b5-917a-e5927db1d4f7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:28.015243 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6d181b84-ea85-43b5-917a-e5927db1d4f7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:28.016018 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6d181b84-ea85-43b5-917a-e5927db1d4f7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:28.016476 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6d181b84-ea85-43b5-917a-e5927db1d4f7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:28.432401 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-714f7e78-bc7a-417f-8a61-9dcee92f82a5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:28.433465 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-714f7e78-bc7a-417f-8a61-9dcee92f82a5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:28.435869 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-6d181b84-ea85-43b5-917a-e5927db1d4f7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:28.447029 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-6d181b84-ea85-43b5-917a-e5927db1d4f7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:28.449659 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-6d181b84-ea85-43b5-917a-e5927db1d4f7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:28.451373 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-714f7e78-bc7a-417f-8a61-9dcee92f82a5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:28.451611 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-6d181b84-ea85-43b5-917a-e5927db1d4f7 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1730 microversion: 2.20 time: 0.446723 Nov 16 00:35:28.452265 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-714f7e78-bc7a-417f-8a61-9dcee92f82a5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:28.463278 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 461/919] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:28 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1730 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:28.465477 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-714f7e78-bc7a-417f-8a61-9dcee92f82a5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:28.466117 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-714f7e78-bc7a-417f-8a61-9dcee92f82a5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:28.612676 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-579045ae-0782-451c-a67b-b20fca65d2b2 req-9390ecd2-8b01-4445-99ed-d3ff6496e341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de441742-51f2-454f-902d-c9da73b74a14", "tag": "dd1e79b1-adea-4951-9c03-a4819deabd55"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:35:28.616566 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:35:28.616566 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:35:28.628967 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-579045ae-0782-451c-a67b-b20fca65d2b2 req-9390ecd2-8b01-4445-99ed-d3ff6496e341 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:28.631581 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-579045ae-0782-451c-a67b-b20fca65d2b2 req-9390ecd2-8b01-4445-99ed-d3ff6496e341 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:28.650637 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-579045ae-0782-451c-a67b-b20fca65d2b2 req-9390ecd2-8b01-4445-99ed-d3ff6496e341 service nova] Creating event network-changed:dd1e79b1-adea-4951-9c03-a4819deabd55 for instance de441742-51f2-454f-902d-c9da73b74a14 on hv-cinder-81115 Nov 16 00:35:28.665442 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-579045ae-0782-451c-a67b-b20fca65d2b2 req-9390ecd2-8b01-4445-99ed-d3ff6496e341 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059596 Nov 16 00:35:28.666206 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 462/920] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:35:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:35:28.871758 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-25bc3d7a-7dd2-46e3-96a5-3e79a06935f7 req-520d8384-609f-4db9-bcc8-cedc35971d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7f9627-db3b-428d-819b-5c5c59084942", "name": "network-vif-plugged", "status": "completed", "tag": "13925c20-f053-442a-8124-fd021f837b58"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:35:28.873351 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:35:28.873351 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:35:28.879217 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-714f7e78-bc7a-417f-8a61-9dcee92f82a5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:28.890089 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-714f7e78-bc7a-417f-8a61-9dcee92f82a5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1318 microversion: 2.1 time: 0.461411 Nov 16 00:35:28.891904 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 459/921] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:28 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1318 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:28.903114 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-25bc3d7a-7dd2-46e3-96a5-3e79a06935f7 req-520d8384-609f-4db9-bcc8-cedc35971d2f service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:28.903791 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-25bc3d7a-7dd2-46e3-96a5-3e79a06935f7 req-520d8384-609f-4db9-bcc8-cedc35971d2f service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:28.911949 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-805bc32c-1b2a-4248-83d1-78f51bf9ab77 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:28.913973 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-805bc32c-1b2a-4248-83d1-78f51bf9ab77 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:28.916774 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-25bc3d7a-7dd2-46e3-96a5-3e79a06935f7 req-520d8384-609f-4db9-bcc8-cedc35971d2f service nova] Creating event network-vif-plugged:13925c20-f053-442a-8124-fd021f837b58 for instance 2f7f9627-db3b-428d-819b-5c5c59084942 on hv-cinder-81115 Nov 16 00:35:28.925393 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-25bc3d7a-7dd2-46e3-96a5-3e79a06935f7 req-520d8384-609f-4db9-bcc8-cedc35971d2f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055451 Nov 16 00:35:28.926896 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 463/922] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:35:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:35:28.927107 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-805bc32c-1b2a-4248-83d1-78f51bf9ab77 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:28.928027 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-805bc32c-1b2a-4248-83d1-78f51bf9ab77 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:28.929186 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-805bc32c-1b2a-4248-83d1-78f51bf9ab77 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:28.929783 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-805bc32c-1b2a-4248-83d1-78f51bf9ab77 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:28.943158 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ca7578bf-7a07-43c5-b780-13d14f912636 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:28.951173 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ca7578bf-7a07-43c5-b780-13d14f912636 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:28.973861 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ca7578bf-7a07-43c5-b780-13d14f912636 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:28.988414 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ca7578bf-7a07-43c5-b780-13d14f912636 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:28.989737 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ca7578bf-7a07-43c5-b780-13d14f912636 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:28.990190 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ca7578bf-7a07-43c5-b780-13d14f912636 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:29.203567 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-805bc32c-1b2a-4248-83d1-78f51bf9ab77 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:29.211408 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-805bc32c-1b2a-4248-83d1-78f51bf9ab77 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1260 microversion: 2.1 time: 0.309244 Nov 16 00:35:29.212203 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 460/923] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:28 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1260 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:29.332834 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-ca7578bf-7a07-43c5-b780-13d14f912636 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:29.340596 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ca7578bf-7a07-43c5-b780-13d14f912636 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1267 microversion: 2.1 time: 0.402704 Nov 16 00:35:29.341159 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 464/924] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:28 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1267 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:29.469661 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-58368725-ac3f-47d1-81c8-889877d22c29 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:29.470221 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-58368725-ac3f-47d1-81c8-889877d22c29 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:29.476213 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-58368725-ac3f-47d1-81c8-889877d22c29 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:29.476667 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-58368725-ac3f-47d1-81c8-889877d22c29 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:29.477444 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-58368725-ac3f-47d1-81c8-889877d22c29 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:29.477876 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-58368725-ac3f-47d1-81c8-889877d22c29 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:29.611306 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-58368725-ac3f-47d1-81c8-889877d22c29 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:29.619980 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-58368725-ac3f-47d1-81c8-889877d22c29 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:29.621342 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-58368725-ac3f-47d1-81c8-889877d22c29 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:29.622624 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-58368725-ac3f-47d1-81c8-889877d22c29 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1730 microversion: 2.20 time: 0.156835 Nov 16 00:35:29.623192 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 461/925] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:29 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:29.908378 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-cf9bf07c-dd5a-487f-b191-c4c8f47c07f3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:29.909787 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-cf9bf07c-dd5a-487f-b191-c4c8f47c07f3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:29.916139 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cf9bf07c-dd5a-487f-b191-c4c8f47c07f3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:29.916839 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cf9bf07c-dd5a-487f-b191-c4c8f47c07f3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:29.917785 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cf9bf07c-dd5a-487f-b191-c4c8f47c07f3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:29.918386 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cf9bf07c-dd5a-487f-b191-c4c8f47c07f3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:30.085044 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-cf9bf07c-dd5a-487f-b191-c4c8f47c07f3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:30.094457 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-cf9bf07c-dd5a-487f-b191-c4c8f47c07f3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1318 microversion: 2.1 time: 0.190217 Nov 16 00:35:30.099340 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 465/926] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:29 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:30.230968 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-4659151b-89cd-472e-a4f7-8e3d5c399daf tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:30.231702 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-4659151b-89cd-472e-a4f7-8e3d5c399daf tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:30.239381 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4659151b-89cd-472e-a4f7-8e3d5c399daf tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:30.240072 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4659151b-89cd-472e-a4f7-8e3d5c399daf tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:30.240973 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4659151b-89cd-472e-a4f7-8e3d5c399daf tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:30.241498 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4659151b-89cd-472e-a4f7-8e3d5c399daf tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:30.357400 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f1060aa6-241c-44be-a61e-47de1a60732a tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:30.358357 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f1060aa6-241c-44be-a61e-47de1a60732a tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:30.365882 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f1060aa6-241c-44be-a61e-47de1a60732a tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:30.366708 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f1060aa6-241c-44be-a61e-47de1a60732a tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:30.367840 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f1060aa6-241c-44be-a61e-47de1a60732a tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:30.368568 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f1060aa6-241c-44be-a61e-47de1a60732a tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:30.422898 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-4659151b-89cd-472e-a4f7-8e3d5c399daf tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:30.430790 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-4659151b-89cd-472e-a4f7-8e3d5c399daf tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1260 microversion: 2.1 time: 0.203485 Nov 16 00:35:30.431426 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 462/927] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:30 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:30.516797 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-f1060aa6-241c-44be-a61e-47de1a60732a tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:30.525920 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f1060aa6-241c-44be-a61e-47de1a60732a tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1267 microversion: 2.1 time: 0.172076 Nov 16 00:35:30.526767 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 466/928] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:30 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:30.642790 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-7d349d6f-0c71-4c82-9e7f-b8852d1676b2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:30.643478 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-7d349d6f-0c71-4c82-9e7f-b8852d1676b2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:30.649924 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7d349d6f-0c71-4c82-9e7f-b8852d1676b2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:30.650361 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7d349d6f-0c71-4c82-9e7f-b8852d1676b2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:30.651407 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7d349d6f-0c71-4c82-9e7f-b8852d1676b2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:30.651841 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7d349d6f-0c71-4c82-9e7f-b8852d1676b2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:30.827269 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-7d349d6f-0c71-4c82-9e7f-b8852d1676b2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:30.837506 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-7d349d6f-0c71-4c82-9e7f-b8852d1676b2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:30.839363 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-7d349d6f-0c71-4c82-9e7f-b8852d1676b2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:30.840673 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-7d349d6f-0c71-4c82-9e7f-b8852d1676b2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1730 microversion: 2.20 time: 0.202321 Nov 16 00:35:30.843095 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 463/929] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:30 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:35:30.956024 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-e739bddb-a8d3-4207-9581-4fe256b7385a req-217a97e0-da1f-4d6f-9df3-2f12a6393e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2b3498-9dc0-415d-8e78-dee875d29a7f", "name": "network-vif-plugged", "status": "completed", "tag": "e9de811a-ed83-4234-81b8-9dda4ea6612f"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:35:30.957744 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:35:30.957744 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:35:30.966284 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-e739bddb-a8d3-4207-9581-4fe256b7385a req-217a97e0-da1f-4d6f-9df3-2f12a6393e2c service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:30.966802 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-e739bddb-a8d3-4207-9581-4fe256b7385a req-217a97e0-da1f-4d6f-9df3-2f12a6393e2c service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:30.980813 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-e739bddb-a8d3-4207-9581-4fe256b7385a req-217a97e0-da1f-4d6f-9df3-2f12a6393e2c service nova] Creating event network-vif-plugged:e9de811a-ed83-4234-81b8-9dda4ea6612f for instance 4d2b3498-9dc0-415d-8e78-dee875d29a7f on hv-cinder-81115 Nov 16 00:35:30.986006 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-e739bddb-a8d3-4207-9581-4fe256b7385a req-217a97e0-da1f-4d6f-9df3-2f12a6393e2c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034111 Nov 16 00:35:30.986825 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 467/930] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:35:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:35:31.112596 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-c5b71571-14aa-42f6-a6c9-a6b62ff7b080 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:31.113531 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-c5b71571-14aa-42f6-a6c9-a6b62ff7b080 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:31.120511 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c5b71571-14aa-42f6-a6c9-a6b62ff7b080 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:31.120959 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c5b71571-14aa-42f6-a6c9-a6b62ff7b080 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:31.121762 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c5b71571-14aa-42f6-a6c9-a6b62ff7b080 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:31.122259 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c5b71571-14aa-42f6-a6c9-a6b62ff7b080 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:31.274679 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-c5b71571-14aa-42f6-a6c9-a6b62ff7b080 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:31.284065 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-c5b71571-14aa-42f6-a6c9-a6b62ff7b080 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1318 microversion: 2.1 time: 0.175939 Nov 16 00:35:31.284999 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 464/931] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:31 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:31.448649 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-e029f413-67a1-4896-aec6-2101d1e9fac1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:31.449338 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-e029f413-67a1-4896-aec6-2101d1e9fac1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:31.461533 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e029f413-67a1-4896-aec6-2101d1e9fac1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:31.462267 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e029f413-67a1-4896-aec6-2101d1e9fac1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:31.463650 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e029f413-67a1-4896-aec6-2101d1e9fac1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:31.464381 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e029f413-67a1-4896-aec6-2101d1e9fac1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:31.544983 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-1d25668a-5446-400d-a9c3-9a2f3bbbacdd tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:31.547987 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-1d25668a-5446-400d-a9c3-9a2f3bbbacdd tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:31.552931 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1d25668a-5446-400d-a9c3-9a2f3bbbacdd tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:31.553373 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1d25668a-5446-400d-a9c3-9a2f3bbbacdd tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:31.554149 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1d25668a-5446-400d-a9c3-9a2f3bbbacdd tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:31.554582 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1d25668a-5446-400d-a9c3-9a2f3bbbacdd tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:31.632130 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e029f413-67a1-4896-aec6-2101d1e9fac1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:31.640601 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-e029f413-67a1-4896-aec6-2101d1e9fac1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1260 microversion: 2.1 time: 0.196427 Nov 16 00:35:31.641185 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 468/932] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:31 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:31.741756 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-1d25668a-5446-400d-a9c3-9a2f3bbbacdd tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:31.750840 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-1d25668a-5446-400d-a9c3-9a2f3bbbacdd tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1267 microversion: 2.1 time: 0.209617 Nov 16 00:35:31.762802 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 465/933] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:31 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:31.859664 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-e73c8cb3-9e78-463a-bc2a-294c1c2a27b2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:31.860190 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-e73c8cb3-9e78-463a-bc2a-294c1c2a27b2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:31.867734 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e73c8cb3-9e78-463a-bc2a-294c1c2a27b2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:31.868218 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e73c8cb3-9e78-463a-bc2a-294c1c2a27b2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:31.868973 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e73c8cb3-9e78-463a-bc2a-294c1c2a27b2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:31.869406 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e73c8cb3-9e78-463a-bc2a-294c1c2a27b2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:32.063329 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e73c8cb3-9e78-463a-bc2a-294c1c2a27b2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:32.074990 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e73c8cb3-9e78-463a-bc2a-294c1c2a27b2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:32.077783 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e73c8cb3-9e78-463a-bc2a-294c1c2a27b2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:32.077783 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-e73c8cb3-9e78-463a-bc2a-294c1c2a27b2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1730 microversion: 2.20 time: 0.222012 Nov 16 00:35:32.078320 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 469/934] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:31 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:35:32.304041 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-c1704f00-c56c-426f-869a-48295ea80674 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:32.304741 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-c1704f00-c56c-426f-869a-48295ea80674 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:32.311933 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c1704f00-c56c-426f-869a-48295ea80674 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:32.312380 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c1704f00-c56c-426f-869a-48295ea80674 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:32.313158 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c1704f00-c56c-426f-869a-48295ea80674 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:32.313587 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c1704f00-c56c-426f-869a-48295ea80674 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:32.468134 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-c1704f00-c56c-426f-869a-48295ea80674 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:32.476168 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-c1704f00-c56c-426f-869a-48295ea80674 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1318 microversion: 2.1 time: 0.175804 Nov 16 00:35:32.476745 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 466/935] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:32 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:32.657559 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8e83bd3c-227b-49b9-a3f1-fa14d2befaa1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:32.658476 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8e83bd3c-227b-49b9-a3f1-fa14d2befaa1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:32.665934 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8e83bd3c-227b-49b9-a3f1-fa14d2befaa1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:32.666618 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8e83bd3c-227b-49b9-a3f1-fa14d2befaa1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:32.667618 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8e83bd3c-227b-49b9-a3f1-fa14d2befaa1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:32.668207 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8e83bd3c-227b-49b9-a3f1-fa14d2befaa1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:32.769208 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3fccf0bf-49c2-422a-bce3-bb1c98aa3274 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:32.769815 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3fccf0bf-49c2-422a-bce3-bb1c98aa3274 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:32.777866 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3fccf0bf-49c2-422a-bce3-bb1c98aa3274 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:32.778754 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3fccf0bf-49c2-422a-bce3-bb1c98aa3274 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:32.779693 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3fccf0bf-49c2-422a-bce3-bb1c98aa3274 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:32.780232 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3fccf0bf-49c2-422a-bce3-bb1c98aa3274 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:32.803880 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-8e83bd3c-227b-49b9-a3f1-fa14d2befaa1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:32.811399 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8e83bd3c-227b-49b9-a3f1-fa14d2befaa1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1260 microversion: 2.1 time: 0.157512 Nov 16 00:35:32.811985 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 470/936] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:32 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:32.918085 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3fccf0bf-49c2-422a-bce3-bb1c98aa3274 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:32.928906 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-3fccf0bf-49c2-422a-bce3-bb1c98aa3274 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1267 microversion: 2.1 time: 0.163803 Nov 16 00:35:32.930205 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 467/937] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:32 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:33.096676 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-7f4bd9cf-9650-4636-baf5-302a807cb2a3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:33.097289 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-7f4bd9cf-9650-4636-baf5-302a807cb2a3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:33.103544 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7f4bd9cf-9650-4636-baf5-302a807cb2a3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:33.104110 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7f4bd9cf-9650-4636-baf5-302a807cb2a3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:33.104909 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7f4bd9cf-9650-4636-baf5-302a807cb2a3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:33.105336 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7f4bd9cf-9650-4636-baf5-302a807cb2a3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:33.239854 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-7f4bd9cf-9650-4636-baf5-302a807cb2a3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:33.248289 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-7f4bd9cf-9650-4636-baf5-302a807cb2a3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:33.249770 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-7f4bd9cf-9650-4636-baf5-302a807cb2a3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:33.250962 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-7f4bd9cf-9650-4636-baf5-302a807cb2a3 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1730 microversion: 2.20 time: 0.158640 Nov 16 00:35:33.251862 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 471/938] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:33 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:33.493569 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-30fc5c67-2723-4a5a-8491-f741ba5de93f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:33.494103 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-30fc5c67-2723-4a5a-8491-f741ba5de93f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:33.500585 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-30fc5c67-2723-4a5a-8491-f741ba5de93f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:33.501068 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-30fc5c67-2723-4a5a-8491-f741ba5de93f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:33.502013 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-30fc5c67-2723-4a5a-8491-f741ba5de93f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:33.502497 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-30fc5c67-2723-4a5a-8491-f741ba5de93f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:33.656292 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-30fc5c67-2723-4a5a-8491-f741ba5de93f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:33.670733 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-30fc5c67-2723-4a5a-8491-f741ba5de93f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1318 microversion: 2.1 time: 0.180878 Nov 16 00:35:33.671565 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 468/939] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:33 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:33.832033 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-d8d2e908-697c-4e93-8ea9-90258be29d19 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:33.833174 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d8d2e908-697c-4e93-8ea9-90258be29d19 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:33.847415 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d8d2e908-697c-4e93-8ea9-90258be29d19 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:33.848463 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d8d2e908-697c-4e93-8ea9-90258be29d19 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:33.849571 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d8d2e908-697c-4e93-8ea9-90258be29d19 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:33.850381 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d8d2e908-697c-4e93-8ea9-90258be29d19 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:33.950596 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-75e5b770-6a6e-4635-9b35-77883524ee4e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:33.951834 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-75e5b770-6a6e-4635-9b35-77883524ee4e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:33.960637 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-75e5b770-6a6e-4635-9b35-77883524ee4e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:33.963521 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-75e5b770-6a6e-4635-9b35-77883524ee4e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:33.964436 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-75e5b770-6a6e-4635-9b35-77883524ee4e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:33.966425 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-75e5b770-6a6e-4635-9b35-77883524ee4e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:34.020480 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-d8d2e908-697c-4e93-8ea9-90258be29d19 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:34.030004 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-d8d2e908-697c-4e93-8ea9-90258be29d19 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1260 microversion: 2.1 time: 0.202280 Nov 16 00:35:34.030233 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 472/940] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:33 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:34.125204 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-75e5b770-6a6e-4635-9b35-77883524ee4e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:34.134167 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-75e5b770-6a6e-4635-9b35-77883524ee4e tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1267 microversion: 2.1 time: 0.189871 Nov 16 00:35:34.134753 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 469/941] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:33 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:34.270287 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-0eb50312-2b95-4d58-9823-e83765dc83ec tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:34.270854 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-0eb50312-2b95-4d58-9823-e83765dc83ec tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:34.277038 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0eb50312-2b95-4d58-9823-e83765dc83ec tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:34.277480 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0eb50312-2b95-4d58-9823-e83765dc83ec tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:34.278264 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0eb50312-2b95-4d58-9823-e83765dc83ec tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:34.278694 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0eb50312-2b95-4d58-9823-e83765dc83ec tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:34.425477 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-0eb50312-2b95-4d58-9823-e83765dc83ec tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:34.433519 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-0eb50312-2b95-4d58-9823-e83765dc83ec tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:34.435008 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-0eb50312-2b95-4d58-9823-e83765dc83ec tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:34.436580 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-0eb50312-2b95-4d58-9823-e83765dc83ec tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1730 microversion: 2.20 time: 0.170584 Nov 16 00:35:34.437270 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 473/942] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:34 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:34.689949 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-5104da49-ca63-4a12-91a9-46ecb8175c0e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:34.690568 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-5104da49-ca63-4a12-91a9-46ecb8175c0e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:34.696409 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5104da49-ca63-4a12-91a9-46ecb8175c0e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:34.696849 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5104da49-ca63-4a12-91a9-46ecb8175c0e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:34.697606 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5104da49-ca63-4a12-91a9-46ecb8175c0e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:34.698033 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5104da49-ca63-4a12-91a9-46ecb8175c0e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:34.833145 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-5104da49-ca63-4a12-91a9-46ecb8175c0e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:34.841070 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-5104da49-ca63-4a12-91a9-46ecb8175c0e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1318 microversion: 2.1 time: 0.155390 Nov 16 00:35:34.842007 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 470/943] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:34 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:35.047444 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1a900e0d-aea2-41b4-bd5a-12ac7378f11a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:35.048048 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1a900e0d-aea2-41b4-bd5a-12ac7378f11a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:35.054637 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1a900e0d-aea2-41b4-bd5a-12ac7378f11a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:35.055107 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1a900e0d-aea2-41b4-bd5a-12ac7378f11a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:35.055896 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1a900e0d-aea2-41b4-bd5a-12ac7378f11a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:35.056323 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1a900e0d-aea2-41b4-bd5a-12ac7378f11a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:35.153318 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-23647ab4-6025-4781-bb99-828f001577ce tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:35.154340 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-23647ab4-6025-4781-bb99-828f001577ce tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:35.169565 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-23647ab4-6025-4781-bb99-828f001577ce tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:35.170272 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-23647ab4-6025-4781-bb99-828f001577ce tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:35.171252 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-23647ab4-6025-4781-bb99-828f001577ce tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:35.171842 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-23647ab4-6025-4781-bb99-828f001577ce tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:35.228398 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-1a900e0d-aea2-41b4-bd5a-12ac7378f11a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:35.237021 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-1a900e0d-aea2-41b4-bd5a-12ac7378f11a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1260 microversion: 2.1 time: 0.192979 Nov 16 00:35:35.239096 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 474/944] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:35 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:35.318834 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-23647ab4-6025-4781-bb99-828f001577ce tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:35.326315 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-23647ab4-6025-4781-bb99-828f001577ce tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1267 microversion: 2.1 time: 0.176934 Nov 16 00:35:35.326889 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 471/945] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:35 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:35.457762 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-7fe8984c-522d-4993-86c3-68090d39b2bd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:35.458369 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-7fe8984c-522d-4993-86c3-68090d39b2bd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:35.464490 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7fe8984c-522d-4993-86c3-68090d39b2bd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:35.464939 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7fe8984c-522d-4993-86c3-68090d39b2bd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:35.465722 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7fe8984c-522d-4993-86c3-68090d39b2bd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:35.466149 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7fe8984c-522d-4993-86c3-68090d39b2bd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:35.617671 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-7fe8984c-522d-4993-86c3-68090d39b2bd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:35.626436 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-7fe8984c-522d-4993-86c3-68090d39b2bd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:35.629801 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-7fe8984c-522d-4993-86c3-68090d39b2bd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:35.631279 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-7fe8984c-522d-4993-86c3-68090d39b2bd tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1730 microversion: 2.20 time: 0.178382 Nov 16 00:35:35.636545 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 475/946] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:35 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:35.859244 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-18de7e07-e91b-44db-991d-656bf6c03b1f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:35.859767 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-18de7e07-e91b-44db-991d-656bf6c03b1f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:35.866860 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-18de7e07-e91b-44db-991d-656bf6c03b1f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:35.867337 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-18de7e07-e91b-44db-991d-656bf6c03b1f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:35.868241 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-18de7e07-e91b-44db-991d-656bf6c03b1f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:35.868678 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-18de7e07-e91b-44db-991d-656bf6c03b1f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:36.011170 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-18de7e07-e91b-44db-991d-656bf6c03b1f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:36.018408 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-18de7e07-e91b-44db-991d-656bf6c03b1f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1318 microversion: 2.1 time: 0.163008 Nov 16 00:35:36.018970 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 472/947] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:35 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:36.253952 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-69375d35-5ea4-4639-89f7-5dd268e729a3 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:36.254508 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-69375d35-5ea4-4639-89f7-5dd268e729a3 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:36.260589 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-69375d35-5ea4-4639-89f7-5dd268e729a3 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:36.261290 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-69375d35-5ea4-4639-89f7-5dd268e729a3 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:36.262598 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-69375d35-5ea4-4639-89f7-5dd268e729a3 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:36.263672 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-69375d35-5ea4-4639-89f7-5dd268e729a3 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:36.343625 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-7762e5ae-3f40-41ad-9bf5-e5ccbe3e7cb2 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:36.344588 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-7762e5ae-3f40-41ad-9bf5-e5ccbe3e7cb2 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:36.356985 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7762e5ae-3f40-41ad-9bf5-e5ccbe3e7cb2 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:36.357428 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7762e5ae-3f40-41ad-9bf5-e5ccbe3e7cb2 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:36.358204 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7762e5ae-3f40-41ad-9bf5-e5ccbe3e7cb2 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:36.358629 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7762e5ae-3f40-41ad-9bf5-e5ccbe3e7cb2 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:36.435407 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-69375d35-5ea4-4639-89f7-5dd268e729a3 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:36.439825 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-69375d35-5ea4-4639-89f7-5dd268e729a3 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1260 microversion: 2.1 time: 0.189582 Nov 16 00:35:36.440457 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 476/948] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:36 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:36.491851 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-7762e5ae-3f40-41ad-9bf5-e5ccbe3e7cb2 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:36.499444 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-7762e5ae-3f40-41ad-9bf5-e5ccbe3e7cb2 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1267 microversion: 2.1 time: 0.159452 Nov 16 00:35:36.500018 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 473/949] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:36 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:36.650032 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-630df914-8f3c-4149-86ad-f5c2434db87e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:36.650754 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-630df914-8f3c-4149-86ad-f5c2434db87e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:36.656585 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-630df914-8f3c-4149-86ad-f5c2434db87e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:36.657022 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-630df914-8f3c-4149-86ad-f5c2434db87e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:36.657799 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-630df914-8f3c-4149-86ad-f5c2434db87e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:36.658836 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-630df914-8f3c-4149-86ad-f5c2434db87e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:36.791654 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-630df914-8f3c-4149-86ad-f5c2434db87e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:36.800460 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-630df914-8f3c-4149-86ad-f5c2434db87e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:36.801951 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-630df914-8f3c-4149-86ad-f5c2434db87e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:36.803153 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-630df914-8f3c-4149-86ad-f5c2434db87e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1730 microversion: 2.20 time: 0.156833 Nov 16 00:35:36.803910 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 477/950] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:36 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:37.035940 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-90604fc2-a9c9-4a5f-81f2-14143722799c tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:37.036491 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-90604fc2-a9c9-4a5f-81f2-14143722799c tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:37.042372 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-90604fc2-a9c9-4a5f-81f2-14143722799c tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:37.042813 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-90604fc2-a9c9-4a5f-81f2-14143722799c tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:37.043625 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-90604fc2-a9c9-4a5f-81f2-14143722799c tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:37.044054 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-90604fc2-a9c9-4a5f-81f2-14143722799c tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:37.180445 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-90604fc2-a9c9-4a5f-81f2-14143722799c tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:37.188624 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-90604fc2-a9c9-4a5f-81f2-14143722799c tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1318 microversion: 2.1 time: 0.156810 Nov 16 00:35:37.190098 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 474/951] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:37 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:37.458755 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-9a44cc1c-a70a-49fa-82c8-17c464e79019 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:37.460285 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-9a44cc1c-a70a-49fa-82c8-17c464e79019 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:37.467466 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9a44cc1c-a70a-49fa-82c8-17c464e79019 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:37.467946 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9a44cc1c-a70a-49fa-82c8-17c464e79019 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:37.468687 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9a44cc1c-a70a-49fa-82c8-17c464e79019 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:37.469114 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9a44cc1c-a70a-49fa-82c8-17c464e79019 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:37.516040 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e45d643e-c204-422f-80da-f07cde3c5010 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:37.516647 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e45d643e-c204-422f-80da-f07cde3c5010 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:37.523221 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e45d643e-c204-422f-80da-f07cde3c5010 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:37.523221 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e45d643e-c204-422f-80da-f07cde3c5010 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:37.524016 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e45d643e-c204-422f-80da-f07cde3c5010 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:37.524445 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e45d643e-c204-422f-80da-f07cde3c5010 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:37.614763 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-9a44cc1c-a70a-49fa-82c8-17c464e79019 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:37.622003 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-9a44cc1c-a70a-49fa-82c8-17c464e79019 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1260 microversion: 2.1 time: 0.168399 Nov 16 00:35:37.622573 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 478/952] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:37 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:37.687496 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e45d643e-c204-422f-80da-f07cde3c5010 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:37.695939 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e45d643e-c204-422f-80da-f07cde3c5010 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1267 microversion: 2.1 time: 0.183458 Nov 16 00:35:37.696518 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 475/953] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:37 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:37.822310 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-78a77904-022b-443e-a608-ec1649516dba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:37.822968 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-78a77904-022b-443e-a608-ec1649516dba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:37.829015 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-78a77904-022b-443e-a608-ec1649516dba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:37.829455 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-78a77904-022b-443e-a608-ec1649516dba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:37.830864 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-78a77904-022b-443e-a608-ec1649516dba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:37.831652 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-78a77904-022b-443e-a608-ec1649516dba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:37.980382 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-78a77904-022b-443e-a608-ec1649516dba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:37.989424 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-78a77904-022b-443e-a608-ec1649516dba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:37.990894 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-78a77904-022b-443e-a608-ec1649516dba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:37.992609 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-78a77904-022b-443e-a608-ec1649516dba tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1730 microversion: 2.20 time: 0.174016 Nov 16 00:35:37.993314 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 479/954] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:37 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:38.209232 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d5857d52-8cb6-4fdd-b015-29f13a4d46fc tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:38.209897 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d5857d52-8cb6-4fdd-b015-29f13a4d46fc tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:38.216008 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d5857d52-8cb6-4fdd-b015-29f13a4d46fc tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:38.216455 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d5857d52-8cb6-4fdd-b015-29f13a4d46fc tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:38.217232 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d5857d52-8cb6-4fdd-b015-29f13a4d46fc tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:38.217660 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d5857d52-8cb6-4fdd-b015-29f13a4d46fc tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:38.375452 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d5857d52-8cb6-4fdd-b015-29f13a4d46fc tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:38.389579 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d5857d52-8cb6-4fdd-b015-29f13a4d46fc tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1318 microversion: 2.1 time: 0.184985 Nov 16 00:35:38.395123 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 476/955] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:38 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:38.638095 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-45f0b601-9549-4767-9e10-3c997202b34c tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:38.638712 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-45f0b601-9549-4767-9e10-3c997202b34c tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:38.645409 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-45f0b601-9549-4767-9e10-3c997202b34c tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:38.645848 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-45f0b601-9549-4767-9e10-3c997202b34c tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:38.646852 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-45f0b601-9549-4767-9e10-3c997202b34c tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:38.647392 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-45f0b601-9549-4767-9e10-3c997202b34c tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:38.713794 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-40949bbf-a74d-446b-ba2a-b6103ec93428 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:38.714420 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-40949bbf-a74d-446b-ba2a-b6103ec93428 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:38.720956 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-40949bbf-a74d-446b-ba2a-b6103ec93428 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:38.721414 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-40949bbf-a74d-446b-ba2a-b6103ec93428 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:38.722290 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-40949bbf-a74d-446b-ba2a-b6103ec93428 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:38.722721 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-40949bbf-a74d-446b-ba2a-b6103ec93428 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:38.883412 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-45f0b601-9549-4767-9e10-3c997202b34c tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:38.891375 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-45f0b601-9549-4767-9e10-3c997202b34c tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1260 microversion: 2.1 time: 0.256518 Nov 16 00:35:38.892058 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 480/956] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:38 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1260 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:38.926549 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-40949bbf-a74d-446b-ba2a-b6103ec93428 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:38.936200 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-40949bbf-a74d-446b-ba2a-b6103ec93428 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1267 microversion: 2.1 time: 0.226945 Nov 16 00:35:38.937525 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 477/957] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:38 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:39.011132 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ed269d96-96a8-41ae-b467-17a125f8d155 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:39.011773 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ed269d96-96a8-41ae-b467-17a125f8d155 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:39.017929 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ed269d96-96a8-41ae-b467-17a125f8d155 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:39.018372 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ed269d96-96a8-41ae-b467-17a125f8d155 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:39.019237 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ed269d96-96a8-41ae-b467-17a125f8d155 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:39.019679 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ed269d96-96a8-41ae-b467-17a125f8d155 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:39.176195 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-ed269d96-96a8-41ae-b467-17a125f8d155 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:39.184123 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-ed269d96-96a8-41ae-b467-17a125f8d155 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:39.185694 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-ed269d96-96a8-41ae-b467-17a125f8d155 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:39.186951 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ed269d96-96a8-41ae-b467-17a125f8d155 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1730 microversion: 2.20 time: 0.179672 Nov 16 00:35:39.187680 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 481/958] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:39 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:39.416701 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-6098ab34-989e-44e8-a059-01b38655c6ec tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:39.417301 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-6098ab34-989e-44e8-a059-01b38655c6ec tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:39.423915 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6098ab34-989e-44e8-a059-01b38655c6ec tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:39.423915 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6098ab34-989e-44e8-a059-01b38655c6ec tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:39.424744 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6098ab34-989e-44e8-a059-01b38655c6ec tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:39.425181 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6098ab34-989e-44e8-a059-01b38655c6ec tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:39.563688 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-6098ab34-989e-44e8-a059-01b38655c6ec tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:39.571349 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-6098ab34-989e-44e8-a059-01b38655c6ec tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1318 microversion: 2.1 time: 0.158472 Nov 16 00:35:39.572133 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 478/959] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:39 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:39.921072 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8472d2ea-c5f4-4160-aaeb-df867e54d97d tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:39.921771 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8472d2ea-c5f4-4160-aaeb-df867e54d97d tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:39.928122 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8472d2ea-c5f4-4160-aaeb-df867e54d97d tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:39.928568 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8472d2ea-c5f4-4160-aaeb-df867e54d97d tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:39.929360 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8472d2ea-c5f4-4160-aaeb-df867e54d97d tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:39.929791 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8472d2ea-c5f4-4160-aaeb-df867e54d97d tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:39.954422 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-110a0148-a0c7-4a1d-b73a-fa95cbf6313f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:39.955938 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-110a0148-a0c7-4a1d-b73a-fa95cbf6313f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:39.962573 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-110a0148-a0c7-4a1d-b73a-fa95cbf6313f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:39.963022 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-110a0148-a0c7-4a1d-b73a-fa95cbf6313f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:39.963843 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-110a0148-a0c7-4a1d-b73a-fa95cbf6313f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:39.964266 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-110a0148-a0c7-4a1d-b73a-fa95cbf6313f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:40.144283 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-8472d2ea-c5f4-4160-aaeb-df867e54d97d tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:40.174662 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8472d2ea-c5f4-4160-aaeb-df867e54d97d tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1260 microversion: 2.1 time: 0.257588 Nov 16 00:35:40.175289 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 482/960] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:39 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1260 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:40.199623 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-110a0148-a0c7-4a1d-b73a-fa95cbf6313f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:40.207936 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-110a0148-a0c7-4a1d-b73a-fa95cbf6313f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1267 microversion: 2.1 time: 0.257143 Nov 16 00:35:40.208581 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 479/961] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:39 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1267 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:40.210612 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ca9d4375-014d-4671-884a-7e4f4c449f6c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:40.211987 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ca9d4375-014d-4671-884a-7e4f4c449f6c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:40.223248 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ca9d4375-014d-4671-884a-7e4f4c449f6c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:40.223893 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ca9d4375-014d-4671-884a-7e4f4c449f6c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:40.225285 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ca9d4375-014d-4671-884a-7e4f4c449f6c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:40.226059 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ca9d4375-014d-4671-884a-7e4f4c449f6c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:40.403089 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-ca9d4375-014d-4671-884a-7e4f4c449f6c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:40.413118 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-ca9d4375-014d-4671-884a-7e4f4c449f6c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:40.414654 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-ca9d4375-014d-4671-884a-7e4f4c449f6c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:40.415865 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ca9d4375-014d-4671-884a-7e4f4c449f6c tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1730 microversion: 2.20 time: 0.213535 Nov 16 00:35:40.416432 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 483/962] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:40 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1730 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:40.588853 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-dc226031-e74c-49be-9290-56c482fbbe24 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:40.589447 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-dc226031-e74c-49be-9290-56c482fbbe24 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:40.596127 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dc226031-e74c-49be-9290-56c482fbbe24 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:40.596579 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dc226031-e74c-49be-9290-56c482fbbe24 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:40.597369 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dc226031-e74c-49be-9290-56c482fbbe24 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:40.597795 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dc226031-e74c-49be-9290-56c482fbbe24 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:40.735529 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-dc226031-e74c-49be-9290-56c482fbbe24 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:40.743870 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-dc226031-e74c-49be-9290-56c482fbbe24 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1318 microversion: 2.1 time: 0.158686 Nov 16 00:35:40.744444 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 480/963] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:40 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:41.192208 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-75b3f71a-f4db-4dc3-8914-5e6d92671906 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:41.192839 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-75b3f71a-f4db-4dc3-8914-5e6d92671906 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:41.198774 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-75b3f71a-f4db-4dc3-8914-5e6d92671906 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:41.199261 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-75b3f71a-f4db-4dc3-8914-5e6d92671906 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:41.200031 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-75b3f71a-f4db-4dc3-8914-5e6d92671906 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:41.200461 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-75b3f71a-f4db-4dc3-8914-5e6d92671906 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:41.226582 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-8c7c1dc5-a7a0-4f1d-809a-747039463ede tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:41.227433 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-8c7c1dc5-a7a0-4f1d-809a-747039463ede tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:41.234046 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8c7c1dc5-a7a0-4f1d-809a-747039463ede tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:41.234498 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8c7c1dc5-a7a0-4f1d-809a-747039463ede tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:41.235306 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8c7c1dc5-a7a0-4f1d-809a-747039463ede tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:41.235740 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8c7c1dc5-a7a0-4f1d-809a-747039463ede tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:41.345171 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-75b3f71a-f4db-4dc3-8914-5e6d92671906 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:41.361012 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-75b3f71a-f4db-4dc3-8914-5e6d92671906 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1260 microversion: 2.1 time: 0.173100 Nov 16 00:35:41.364820 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 484/964] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:41 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:41.390407 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-8c7c1dc5-a7a0-4f1d-809a-747039463ede tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:41.399956 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-8c7c1dc5-a7a0-4f1d-809a-747039463ede tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1267 microversion: 2.1 time: 0.176902 Nov 16 00:35:41.400589 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 481/965] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:41 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:41.437731 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-5ee9d6df-c6d9-493c-9b1f-cb0c56adeba6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:41.438352 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-5ee9d6df-c6d9-493c-9b1f-cb0c56adeba6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:41.445509 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5ee9d6df-c6d9-493c-9b1f-cb0c56adeba6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:41.445813 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5ee9d6df-c6d9-493c-9b1f-cb0c56adeba6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:41.446765 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5ee9d6df-c6d9-493c-9b1f-cb0c56adeba6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:41.447282 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-5ee9d6df-c6d9-493c-9b1f-cb0c56adeba6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:41.704186 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-5ee9d6df-c6d9-493c-9b1f-cb0c56adeba6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:41.712833 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-5ee9d6df-c6d9-493c-9b1f-cb0c56adeba6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:41.714437 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-5ee9d6df-c6d9-493c-9b1f-cb0c56adeba6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:41.715719 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-5ee9d6df-c6d9-493c-9b1f-cb0c56adeba6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1730 microversion: 2.20 time: 0.282676 Nov 16 00:35:41.716346 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 485/966] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:41 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1730 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:41.761278 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d81bd958-8f61-4acf-8808-a8c1db7be8d9 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:41.761889 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d81bd958-8f61-4acf-8808-a8c1db7be8d9 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:41.767959 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d81bd958-8f61-4acf-8808-a8c1db7be8d9 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:41.768410 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d81bd958-8f61-4acf-8808-a8c1db7be8d9 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:41.769722 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d81bd958-8f61-4acf-8808-a8c1db7be8d9 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:41.769722 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d81bd958-8f61-4acf-8808-a8c1db7be8d9 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:41.913622 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d81bd958-8f61-4acf-8808-a8c1db7be8d9 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:41.921020 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d81bd958-8f61-4acf-8808-a8c1db7be8d9 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1318 microversion: 2.1 time: 0.163881 Nov 16 00:35:41.921637 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 482/967] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:41 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:42.379731 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-2acb591c-44c0-4092-af11-774a39c3ebda tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:42.380332 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-2acb591c-44c0-4092-af11-774a39c3ebda tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:42.386703 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2acb591c-44c0-4092-af11-774a39c3ebda tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:42.387178 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2acb591c-44c0-4092-af11-774a39c3ebda tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:42.387982 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2acb591c-44c0-4092-af11-774a39c3ebda tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:42.388421 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2acb591c-44c0-4092-af11-774a39c3ebda tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:42.420739 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-55dbc86b-4a6c-4103-a89a-24530d126a91 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:42.421366 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-55dbc86b-4a6c-4103-a89a-24530d126a91 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:42.427989 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-55dbc86b-4a6c-4103-a89a-24530d126a91 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:42.428427 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-55dbc86b-4a6c-4103-a89a-24530d126a91 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:42.429203 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-55dbc86b-4a6c-4103-a89a-24530d126a91 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:42.429624 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-55dbc86b-4a6c-4103-a89a-24530d126a91 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:42.531438 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2acb591c-44c0-4092-af11-774a39c3ebda tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:42.540382 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-2acb591c-44c0-4092-af11-774a39c3ebda tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1260 microversion: 2.1 time: 0.165114 Nov 16 00:35:42.540971 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 486/968] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:42 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:42.572688 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-55dbc86b-4a6c-4103-a89a-24530d126a91 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:42.581175 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-55dbc86b-4a6c-4103-a89a-24530d126a91 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1267 microversion: 2.1 time: 0.166786 Nov 16 00:35:42.581769 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 483/969] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:42 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:42.740382 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-bd423dd5-3c5b-4a55-8934-5331c85c86d6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:42.741099 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-bd423dd5-3c5b-4a55-8934-5331c85c86d6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:42.749976 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bd423dd5-3c5b-4a55-8934-5331c85c86d6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:42.751003 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bd423dd5-3c5b-4a55-8934-5331c85c86d6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:42.751925 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bd423dd5-3c5b-4a55-8934-5331c85c86d6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:42.752308 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-bd423dd5-3c5b-4a55-8934-5331c85c86d6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:42.900479 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-bd423dd5-3c5b-4a55-8934-5331c85c86d6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:42.915184 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-bd423dd5-3c5b-4a55-8934-5331c85c86d6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:42.916750 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-bd423dd5-3c5b-4a55-8934-5331c85c86d6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:42.918039 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-bd423dd5-3c5b-4a55-8934-5331c85c86d6 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1730 microversion: 2.20 time: 0.187214 Nov 16 00:35:42.918881 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 487/970] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:42 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:42.938909 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-584b7c21-e788-41b1-8767-2ca421b19a67 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:42.939728 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-584b7c21-e788-41b1-8767-2ca421b19a67 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:42.946083 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-584b7c21-e788-41b1-8767-2ca421b19a67 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:42.946533 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-584b7c21-e788-41b1-8767-2ca421b19a67 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:42.947458 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-584b7c21-e788-41b1-8767-2ca421b19a67 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:42.947926 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-584b7c21-e788-41b1-8767-2ca421b19a67 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:43.096993 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-584b7c21-e788-41b1-8767-2ca421b19a67 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:43.107724 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-584b7c21-e788-41b1-8767-2ca421b19a67 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1509 microversion: 2.1 time: 0.172501 Nov 16 00:35:43.108572 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 484/971] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:42 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:43.558043 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-2401292f-025c-42df-aff9-4f498e7a3463 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:43.558700 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-2401292f-025c-42df-aff9-4f498e7a3463 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:43.566384 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2401292f-025c-42df-aff9-4f498e7a3463 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:43.566793 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2401292f-025c-42df-aff9-4f498e7a3463 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:43.567675 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2401292f-025c-42df-aff9-4f498e7a3463 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:43.568154 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2401292f-025c-42df-aff9-4f498e7a3463 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:43.602941 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-9ae089f4-9f16-434a-ac17-b2c94a9abae3 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:43.604137 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-9ae089f4-9f16-434a-ac17-b2c94a9abae3 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:43.615427 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9ae089f4-9f16-434a-ac17-b2c94a9abae3 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:43.616207 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9ae089f4-9f16-434a-ac17-b2c94a9abae3 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:43.617653 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9ae089f4-9f16-434a-ac17-b2c94a9abae3 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:43.618428 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9ae089f4-9f16-434a-ac17-b2c94a9abae3 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:43.765160 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2401292f-025c-42df-aff9-4f498e7a3463 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:43.777733 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-2401292f-025c-42df-aff9-4f498e7a3463 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1443 microversion: 2.1 time: 0.223167 Nov 16 00:35:43.778993 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 488/972] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:43 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1443 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:43.794993 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-be88323b-a75d-449b-8808-19793afeb75b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:43.795652 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-be88323b-a75d-449b-8808-19793afeb75b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:43.801872 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-9ae089f4-9f16-434a-ac17-b2c94a9abae3 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:43.804828 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-be88323b-a75d-449b-8808-19793afeb75b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:43.805895 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-be88323b-a75d-449b-8808-19793afeb75b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:43.807068 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-be88323b-a75d-449b-8808-19793afeb75b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:43.807716 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-be88323b-a75d-449b-8808-19793afeb75b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:43.811967 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-9ae089f4-9f16-434a-ac17-b2c94a9abae3 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1267 microversion: 2.1 time: 0.213630 Nov 16 00:35:43.812922 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 485/973] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:43 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:43.937909 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-68853d4a-b0e6-4b9a-a953-3e6a6e3454ed tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:43.938686 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-68853d4a-b0e6-4b9a-a953-3e6a6e3454ed tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:43.944483 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-be88323b-a75d-449b-8808-19793afeb75b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:43.951207 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-68853d4a-b0e6-4b9a-a953-3e6a6e3454ed tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:43.952107 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-68853d4a-b0e6-4b9a-a953-3e6a6e3454ed tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:43.952528 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-be88323b-a75d-449b-8808-19793afeb75b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1443 microversion: 2.1 time: 0.161233 Nov 16 00:35:43.953116 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 489/974] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:43 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:43.953335 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-68853d4a-b0e6-4b9a-a953-3e6a6e3454ed tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:43.953921 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-68853d4a-b0e6-4b9a-a953-3e6a6e3454ed tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:44.130837 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-68853d4a-b0e6-4b9a-a953-3e6a6e3454ed tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:44.142540 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-68853d4a-b0e6-4b9a-a953-3e6a6e3454ed tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:44.144108 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-68853d4a-b0e6-4b9a-a953-3e6a6e3454ed tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:44.145297 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-68853d4a-b0e6-4b9a-a953-3e6a6e3454ed tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1730 microversion: 2.20 time: 0.212052 Nov 16 00:35:44.145937 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 486/975] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:43 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1730 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:35:44.551452 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-d9963839-1e42-40a6-9ea6-98f4859fdc55 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b963768a-9ec4-4b1f-9d40-58b8b91635ac"}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:35:44.553860 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d9963839-1e42-40a6-9ea6-98f4859fdc55 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:44.565039 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d9963839-1e42-40a6-9ea6-98f4859fdc55 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:44.567618 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d9963839-1e42-40a6-9ea6-98f4859fdc55 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:44.569687 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d9963839-1e42-40a6-9ea6-98f4859fdc55 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:44.570507 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d9963839-1e42-40a6-9ea6-98f4859fdc55 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:44.832133 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-db17a160-20cf-4eba-9ac2-aed97ef1440d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:44.832933 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-db17a160-20cf-4eba-9ac2-aed97ef1440d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:44.842211 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-db17a160-20cf-4eba-9ac2-aed97ef1440d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:44.843809 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-db17a160-20cf-4eba-9ac2-aed97ef1440d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:44.847398 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-db17a160-20cf-4eba-9ac2-aed97ef1440d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:44.865663 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-db17a160-20cf-4eba-9ac2-aed97ef1440d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:44.990165 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-d9963839-1e42-40a6-9ea6-98f4859fdc55 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "POST /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.444046 Nov 16 00:35:44.991846 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 490/976] 10.222.0.31 () {60 vars in 1322 bytes} [Tue Nov 16 00:35:44 2021] POST /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942/os-volume_attachments => generated 194 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:35:45.075847 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-db17a160-20cf-4eba-9ac2-aed97ef1440d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:45.088308 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-db17a160-20cf-4eba-9ac2-aed97ef1440d tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1267 microversion: 2.1 time: 0.261946 Nov 16 00:35:45.089600 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 487/977] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:44 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:45.176310 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-eb6bcf86-79ea-45a4-b3e5-c299ea6df23f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:45.178478 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-eb6bcf86-79ea-45a4-b3e5-c299ea6df23f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:45.198399 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-eb6bcf86-79ea-45a4-b3e5-c299ea6df23f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:45.200049 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-eb6bcf86-79ea-45a4-b3e5-c299ea6df23f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:45.202808 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-eb6bcf86-79ea-45a4-b3e5-c299ea6df23f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:45.205203 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-eb6bcf86-79ea-45a4-b3e5-c299ea6df23f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:45.639471 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-eb6bcf86-79ea-45a4-b3e5-c299ea6df23f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:45.650844 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-eb6bcf86-79ea-45a4-b3e5-c299ea6df23f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:45.652401 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-eb6bcf86-79ea-45a4-b3e5-c299ea6df23f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:45.653729 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-eb6bcf86-79ea-45a4-b3e5-c299ea6df23f tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1730 microversion: 2.20 time: 0.491066 Nov 16 00:35:45.654696 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 491/978] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:45 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1730 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:46.115196 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0af5e1db-dd09-43a2-8b7f-32a699b91005 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:46.116161 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0af5e1db-dd09-43a2-8b7f-32a699b91005 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:46.124900 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0af5e1db-dd09-43a2-8b7f-32a699b91005 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:46.125819 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0af5e1db-dd09-43a2-8b7f-32a699b91005 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:46.127704 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0af5e1db-dd09-43a2-8b7f-32a699b91005 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:46.128561 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0af5e1db-dd09-43a2-8b7f-32a699b91005 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:46.305125 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0af5e1db-dd09-43a2-8b7f-32a699b91005 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:46.319992 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0af5e1db-dd09-43a2-8b7f-32a699b91005 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1267 microversion: 2.1 time: 0.209596 Nov 16 00:35:46.321060 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 488/979] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:46 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:46.687349 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-06697495-1b00-43a4-9c4f-143b7cca0c7b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:46.689967 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-06697495-1b00-43a4-9c4f-143b7cca0c7b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:46.701305 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-06697495-1b00-43a4-9c4f-143b7cca0c7b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:46.702064 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-06697495-1b00-43a4-9c4f-143b7cca0c7b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:46.703032 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-06697495-1b00-43a4-9c4f-143b7cca0c7b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:46.703660 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-06697495-1b00-43a4-9c4f-143b7cca0c7b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:46.802977 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-8dd72ef5-28aa-46cf-9a0f-235665e5ff9d req-17eac13f-1f01-44c7-935b-b7b6b368b025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cabac73-4f43-4f58-941d-fcde21d2fdf2", "name": "network-vif-plugged", "status": "completed", "tag": "24c138f4-ee49-4e30-8553-2bc8c5029b8d"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:35:46.805626 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:35:46.805626 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:35:46.819370 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-8dd72ef5-28aa-46cf-9a0f-235665e5ff9d req-17eac13f-1f01-44c7-935b-b7b6b368b025 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:46.820753 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-8dd72ef5-28aa-46cf-9a0f-235665e5ff9d req-17eac13f-1f01-44c7-935b-b7b6b368b025 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:46.843094 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-8dd72ef5-28aa-46cf-9a0f-235665e5ff9d req-17eac13f-1f01-44c7-935b-b7b6b368b025 service nova] Creating event network-vif-plugged:24c138f4-ee49-4e30-8553-2bc8c5029b8d for instance 5cabac73-4f43-4f58-941d-fcde21d2fdf2 on hv-cinder-81115 Nov 16 00:35:46.851814 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-8dd72ef5-28aa-46cf-9a0f-235665e5ff9d req-17eac13f-1f01-44c7-935b-b7b6b368b025 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055330 Nov 16 00:35:46.852979 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 489/980] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:35:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:35:46.955690 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-06697495-1b00-43a4-9c4f-143b7cca0c7b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:46.964711 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-06697495-1b00-43a4-9c4f-143b7cca0c7b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:46.967641 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-06697495-1b00-43a4-9c4f-143b7cca0c7b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:46.969228 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-06697495-1b00-43a4-9c4f-143b7cca0c7b tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1730 microversion: 2.20 time: 0.287444 Nov 16 00:35:46.983166 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 492/981] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:46 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1730 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:35:47.108113 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-633c5e8d-53de-403a-8fcf-8f12c5aa9d40 req-552f2a32-324e-4b98-ad2b-5fa1ab673f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d2b3498-9dc0-415d-8e78-dee875d29a7f", "tag": "e9de811a-ed83-4234-81b8-9dda4ea6612f"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:35:47.112863 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:35:47.112863 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:35:47.125830 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-633c5e8d-53de-403a-8fcf-8f12c5aa9d40 req-552f2a32-324e-4b98-ad2b-5fa1ab673f5f service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:47.126877 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-633c5e8d-53de-403a-8fcf-8f12c5aa9d40 req-552f2a32-324e-4b98-ad2b-5fa1ab673f5f service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:47.148716 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-633c5e8d-53de-403a-8fcf-8f12c5aa9d40 req-552f2a32-324e-4b98-ad2b-5fa1ab673f5f service nova] Creating event network-changed:e9de811a-ed83-4234-81b8-9dda4ea6612f for instance 4d2b3498-9dc0-415d-8e78-dee875d29a7f on hv-cinder-81115 Nov 16 00:35:47.160513 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-633c5e8d-53de-403a-8fcf-8f12c5aa9d40 req-552f2a32-324e-4b98-ad2b-5fa1ab673f5f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062018 Nov 16 00:35:47.161568 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 490/982] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:35:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:35:47.347780 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c5ae2ef3-1cde-4263-952b-034cd52a77db tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:47.348474 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c5ae2ef3-1cde-4263-952b-034cd52a77db tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:47.354962 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c5ae2ef3-1cde-4263-952b-034cd52a77db tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:47.355439 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c5ae2ef3-1cde-4263-952b-034cd52a77db tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:47.356259 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c5ae2ef3-1cde-4263-952b-034cd52a77db tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:47.356685 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c5ae2ef3-1cde-4263-952b-034cd52a77db tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:47.596091 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c5ae2ef3-1cde-4263-952b-034cd52a77db tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:47.610637 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c5ae2ef3-1cde-4263-952b-034cd52a77db tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1267 microversion: 2.1 time: 0.267895 Nov 16 00:35:47.613280 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 493/983] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:47 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1267 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:47.998537 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-405ddede-cc6d-44fe-b04d-d6c3fc837a8d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:47.999371 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-405ddede-cc6d-44fe-b04d-d6c3fc837a8d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:48.008282 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-405ddede-cc6d-44fe-b04d-d6c3fc837a8d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:48.009136 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-405ddede-cc6d-44fe-b04d-d6c3fc837a8d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:48.010694 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-405ddede-cc6d-44fe-b04d-d6c3fc837a8d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:48.011350 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-405ddede-cc6d-44fe-b04d-d6c3fc837a8d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:48.202698 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-405ddede-cc6d-44fe-b04d-d6c3fc837a8d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:48.218100 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-405ddede-cc6d-44fe-b04d-d6c3fc837a8d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:48.222283 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-405ddede-cc6d-44fe-b04d-d6c3fc837a8d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:48.224592 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-405ddede-cc6d-44fe-b04d-d6c3fc837a8d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1730 microversion: 2.20 time: 0.230362 Nov 16 00:35:48.225540 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 491/984] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:47 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1730 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:35:48.635616 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1eb39b38-6211-4975-9ce6-39b2cc901c7b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:48.636863 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1eb39b38-6211-4975-9ce6-39b2cc901c7b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:48.646108 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1eb39b38-6211-4975-9ce6-39b2cc901c7b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:48.646786 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1eb39b38-6211-4975-9ce6-39b2cc901c7b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:48.648594 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1eb39b38-6211-4975-9ce6-39b2cc901c7b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:48.649793 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1eb39b38-6211-4975-9ce6-39b2cc901c7b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:48.814965 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-1eb39b38-6211-4975-9ce6-39b2cc901c7b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:48.829422 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-1eb39b38-6211-4975-9ce6-39b2cc901c7b tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1267 microversion: 2.1 time: 0.202549 Nov 16 00:35:48.831004 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 494/985] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:48 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:48.879597 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-cd738609-8c5a-4897-a8bc-5966e5d93027 req-c2f0842f-54e0-4c39-886e-3e1195c80c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de441742-51f2-454f-902d-c9da73b74a14", "name": "network-vif-plugged", "status": "completed", "tag": "dd1e79b1-adea-4951-9c03-a4819deabd55"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:35:48.882763 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:35:48.882763 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:35:48.895700 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-cd738609-8c5a-4897-a8bc-5966e5d93027 req-c2f0842f-54e0-4c39-886e-3e1195c80c47 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:48.896239 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-cd738609-8c5a-4897-a8bc-5966e5d93027 req-c2f0842f-54e0-4c39-886e-3e1195c80c47 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:48.922183 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-cd738609-8c5a-4897-a8bc-5966e5d93027 req-c2f0842f-54e0-4c39-886e-3e1195c80c47 service nova] Creating event network-vif-plugged:dd1e79b1-adea-4951-9c03-a4819deabd55 for instance de441742-51f2-454f-902d-c9da73b74a14 on hv-cinder-81115 Nov 16 00:35:48.927862 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-cd738609-8c5a-4897-a8bc-5966e5d93027 req-c2f0842f-54e0-4c39-886e-3e1195c80c47 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053853 Nov 16 00:35:48.928626 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 492/986] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:35:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:35:49.250039 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-9a24d800-ab08-48bd-b86c-d3d39188bdae tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:49.251027 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-9a24d800-ab08-48bd-b86c-d3d39188bdae tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:49.257828 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9a24d800-ab08-48bd-b86c-d3d39188bdae tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:49.258573 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9a24d800-ab08-48bd-b86c-d3d39188bdae tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:49.259604 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9a24d800-ab08-48bd-b86c-d3d39188bdae tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:49.260272 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9a24d800-ab08-48bd-b86c-d3d39188bdae tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:49.396364 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-9a24d800-ab08-48bd-b86c-d3d39188bdae tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:49.404698 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-9a24d800-ab08-48bd-b86c-d3d39188bdae tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:49.406190 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-9a24d800-ab08-48bd-b86c-d3d39188bdae tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:49.407405 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-9a24d800-ab08-48bd-b86c-d3d39188bdae tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1717 microversion: 2.20 time: 0.161797 Nov 16 00:35:49.408730 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 495/987] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:35:49 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1717 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 00:35:49.851306 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-440d50a3-8b3b-4b54-98bf-c14f2985f83a tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:49.852021 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-440d50a3-8b3b-4b54-98bf-c14f2985f83a tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:49.862937 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-440d50a3-8b3b-4b54-98bf-c14f2985f83a tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:49.863825 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-440d50a3-8b3b-4b54-98bf-c14f2985f83a tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:49.865279 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-440d50a3-8b3b-4b54-98bf-c14f2985f83a tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:49.866122 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-440d50a3-8b3b-4b54-98bf-c14f2985f83a tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:50.017030 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-440d50a3-8b3b-4b54-98bf-c14f2985f83a tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:50.025801 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-440d50a3-8b3b-4b54-98bf-c14f2985f83a tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1267 microversion: 2.1 time: 0.178831 Nov 16 00:35:50.026401 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 493/988] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:49 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:51.044519 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-2d3a87e4-3633-4d15-b377-51c5891705e5 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:51.045292 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-2d3a87e4-3633-4d15-b377-51c5891705e5 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:51.052635 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2d3a87e4-3633-4d15-b377-51c5891705e5 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:51.053138 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2d3a87e4-3633-4d15-b377-51c5891705e5 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:51.053990 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2d3a87e4-3633-4d15-b377-51c5891705e5 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:51.054482 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2d3a87e4-3633-4d15-b377-51c5891705e5 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:51.231615 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2d3a87e4-3633-4d15-b377-51c5891705e5 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:51.240622 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-2d3a87e4-3633-4d15-b377-51c5891705e5 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1455 microversion: 2.1 time: 0.200007 Nov 16 00:35:51.241457 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 496/989] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:51 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1455 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:51.259241 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-26aaa94a-1f91-4d54-ade9-b5a04c8180c1 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:51.260277 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-26aaa94a-1f91-4d54-ade9-b5a04c8180c1 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:51.269311 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-26aaa94a-1f91-4d54-ade9-b5a04c8180c1 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:51.269852 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-26aaa94a-1f91-4d54-ade9-b5a04c8180c1 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:51.270722 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-26aaa94a-1f91-4d54-ade9-b5a04c8180c1 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:51.271353 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-26aaa94a-1f91-4d54-ade9-b5a04c8180c1 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:51.425540 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-26aaa94a-1f91-4d54-ade9-b5a04c8180c1 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:51.434228 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-26aaa94a-1f91-4d54-ade9-b5a04c8180c1 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1455 microversion: 2.1 time: 0.179956 Nov 16 00:35:51.434827 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 494/990] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:51 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1455 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:52.872671 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-33d8399f-0f64-467a-9340-3a1199ac0ae5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-671072479", "imageRef": "bb47ca05-3b48-4f1c-bc96-e0c5c672caba", "flavorRef": "452", "networks": [{"uuid": "3ade04b1-2f01-4769-9a91-0d2df635fcbb"}]}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:35:52.966448 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.network.neutron [None req-33d8399f-0f64-467a-9340-3a1199ac0ae5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] validate_networks() for [('3ade04b1-2f01-4769-9a91-0d2df635fcbb', None, None, None, None, None)] {{(pid=122543) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:35:53.727939 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-961dda83-48e6-4a12-8101-252120f84c21 req-a6f39561-bc1f-4eca-a451-06d0f657326c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de441742-51f2-454f-902d-c9da73b74a14", "tag": "dd1e79b1-adea-4951-9c03-a4819deabd55"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:35:53.730107 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:35:53.730107 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:35:53.741624 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-961dda83-48e6-4a12-8101-252120f84c21 req-a6f39561-bc1f-4eca-a451-06d0f657326c service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:53.742998 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-961dda83-48e6-4a12-8101-252120f84c21 req-a6f39561-bc1f-4eca-a451-06d0f657326c service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:53.758989 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-961dda83-48e6-4a12-8101-252120f84c21 req-a6f39561-bc1f-4eca-a451-06d0f657326c service nova] Creating event network-changed:dd1e79b1-adea-4951-9c03-a4819deabd55 for instance de441742-51f2-454f-902d-c9da73b74a14 on hv-cinder-81115 Nov 16 00:35:53.767320 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-961dda83-48e6-4a12-8101-252120f84c21 req-a6f39561-bc1f-4eca-a451-06d0f657326c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042990 Nov 16 00:35:53.768947 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 495/991] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:35:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:35:53.786611 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-33d8399f-0f64-467a-9340-3a1199ac0ae5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Flavor limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:35:53.787017 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-33d8399f-0f64-467a-9340-3a1199ac0ae5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Image limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:35:53.787762 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-33d8399f-0f64-467a-9340-3a1199ac0ae5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Flavor pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:35:53.788171 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-33d8399f-0f64-467a-9340-3a1199ac0ae5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Image pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:35:53.788581 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-33d8399f-0f64-467a-9340-3a1199ac0ae5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:35:53.798783 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-33d8399f-0f64-467a-9340-3a1199ac0ae5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:53.799451 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-33d8399f-0f64-467a-9340-3a1199ac0ae5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:53.800371 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-33d8399f-0f64-467a-9340-3a1199ac0ae5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:53.800821 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-33d8399f-0f64-467a-9340-3a1199ac0ae5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:53.822527 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-33d8399f-0f64-467a-9340-3a1199ac0ae5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Getting quotas for project 1b08090244b44b94bdedacad6778dec0. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:35:53.827162 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-33d8399f-0f64-467a-9340-3a1199ac0ae5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Getting quotas for user facd3c2e165f495c86342ba380ca5d3b and project 1b08090244b44b94bdedacad6778dec0. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:35:53.841889 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-33d8399f-0f64-467a-9340-3a1199ac0ae5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Going to run 1 instances... {{(pid=122543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:35:53.845199 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-33d8399f-0f64-467a-9340-3a1199ac0ae5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 081f2420-eaa6-4d4c-a750-f4ca807d9d14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb47ca05-3b48-4f1c-bc96-e0c5c672caba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:35:53.899261 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-33d8399f-0f64-467a-9340-3a1199ac0ae5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.033879 Nov 16 00:35:53.901983 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 497/992] 10.222.0.31 () {60 vars in 1146 bytes} [Tue Nov 16 00:35:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 00:35:53.919116 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f57a6e8f-08d3-4880-ad1e-13992b0f170c tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:53.920268 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f57a6e8f-08d3-4880-ad1e-13992b0f170c tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 081f2420-eaa6-4d4c-a750-f4ca807d9d14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:54.014751 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-f57a6e8f-08d3-4880-ad1e-13992b0f170c tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:54.028723 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-f57a6e8f-08d3-4880-ad1e-13992b0f170c tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14" status: 200 len: 1217 microversion: 2.1 time: 0.119336 Nov 16 00:35:54.030236 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 496/993] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:53 2021] GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14 => generated 1217 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:55.053383 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-78cfb7f9-8152-47c2-bd38-68111c0d8ad3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:55.054316 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-78cfb7f9-8152-47c2-bd38-68111c0d8ad3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 081f2420-eaa6-4d4c-a750-f4ca807d9d14] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:55.060850 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-78cfb7f9-8152-47c2-bd38-68111c0d8ad3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:55.061453 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-78cfb7f9-8152-47c2-bd38-68111c0d8ad3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:55.062510 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-78cfb7f9-8152-47c2-bd38-68111c0d8ad3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:55.063267 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-78cfb7f9-8152-47c2-bd38-68111c0d8ad3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:55.167556 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-78cfb7f9-8152-47c2-bd38-68111c0d8ad3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:55.179348 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-78cfb7f9-8152-47c2-bd38-68111c0d8ad3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14" status: 200 len: 1277 microversion: 2.1 time: 0.129766 Nov 16 00:35:55.180665 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 498/994] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:55 2021] GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14 => generated 1277 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:56.204083 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-aa8facfc-15aa-4b2c-a68f-19c746ea80bd tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:56.205797 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-aa8facfc-15aa-4b2c-a68f-19c746ea80bd tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 081f2420-eaa6-4d4c-a750-f4ca807d9d14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:56.213809 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-aa8facfc-15aa-4b2c-a68f-19c746ea80bd tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:56.214386 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-aa8facfc-15aa-4b2c-a68f-19c746ea80bd tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:56.215416 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-aa8facfc-15aa-4b2c-a68f-19c746ea80bd tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:56.216023 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-aa8facfc-15aa-4b2c-a68f-19c746ea80bd tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:56.399278 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-aa8facfc-15aa-4b2c-a68f-19c746ea80bd tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:56.407727 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-aa8facfc-15aa-4b2c-a68f-19c746ea80bd tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14" status: 200 len: 1317 microversion: 2.1 time: 0.207580 Nov 16 00:35:56.408681 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 497/995] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:56 2021] GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:35:56.824375 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-6b5bfd21-4c5c-44b8-a4a8-2164a5da37a4 req-1a9b5b56-a8d8-4e1d-87cc-8b1562032336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "081f2420-eaa6-4d4c-a750-f4ca807d9d14", "tag": "d6680774-dc79-4ad5-a0f2-d8eb25c28626"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:35:56.827790 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:35:56.827790 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:35:56.836524 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-6b5bfd21-4c5c-44b8-a4a8-2164a5da37a4 req-1a9b5b56-a8d8-4e1d-87cc-8b1562032336 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:56.837146 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-6b5bfd21-4c5c-44b8-a4a8-2164a5da37a4 req-1a9b5b56-a8d8-4e1d-87cc-8b1562032336 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:56.850165 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-6b5bfd21-4c5c-44b8-a4a8-2164a5da37a4 req-1a9b5b56-a8d8-4e1d-87cc-8b1562032336 service nova] Creating event network-changed:d6680774-dc79-4ad5-a0f2-d8eb25c28626 for instance 081f2420-eaa6-4d4c-a750-f4ca807d9d14 on hv-cinder-81115 Nov 16 00:35:56.855199 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-6b5bfd21-4c5c-44b8-a4a8-2164a5da37a4 req-1a9b5b56-a8d8-4e1d-87cc-8b1562032336 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034865 Nov 16 00:35:56.855794 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 499/996] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:35:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:35:57.426212 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-ab14a76f-cbd3-47c3-b108-06360da4959c tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:57.426975 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-ab14a76f-cbd3-47c3-b108-06360da4959c tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 081f2420-eaa6-4d4c-a750-f4ca807d9d14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:57.433237 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ab14a76f-cbd3-47c3-b108-06360da4959c tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:57.433673 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ab14a76f-cbd3-47c3-b108-06360da4959c tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:57.434618 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ab14a76f-cbd3-47c3-b108-06360da4959c tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:57.435055 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ab14a76f-cbd3-47c3-b108-06360da4959c tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:57.570938 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-ab14a76f-cbd3-47c3-b108-06360da4959c tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:57.579235 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-ab14a76f-cbd3-47c3-b108-06360da4959c tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14" status: 200 len: 1317 microversion: 2.1 time: 0.157393 Nov 16 00:35:57.579822 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 498/997] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:57 2021] GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:58.604636 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ccc85ef0-7716-4dd4-bff3-9fc509fe41d2 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:58.605363 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ccc85ef0-7716-4dd4-bff3-9fc509fe41d2 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 081f2420-eaa6-4d4c-a750-f4ca807d9d14] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:58.612268 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ccc85ef0-7716-4dd4-bff3-9fc509fe41d2 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:58.612732 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ccc85ef0-7716-4dd4-bff3-9fc509fe41d2 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:58.613600 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ccc85ef0-7716-4dd4-bff3-9fc509fe41d2 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:58.614022 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ccc85ef0-7716-4dd4-bff3-9fc509fe41d2 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:58.759003 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-ccc85ef0-7716-4dd4-bff3-9fc509fe41d2 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:58.766506 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ccc85ef0-7716-4dd4-bff3-9fc509fe41d2 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14" status: 200 len: 1317 microversion: 2.1 time: 0.167332 Nov 16 00:35:58.767659 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 500/998] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:58 2021] GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:35:59.784732 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-da60338c-cd1f-430e-95ad-311b5b0123e7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:35:59.785340 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-da60338c-cd1f-430e-95ad-311b5b0123e7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 081f2420-eaa6-4d4c-a750-f4ca807d9d14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:35:59.791269 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-da60338c-cd1f-430e-95ad-311b5b0123e7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:59.791710 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-da60338c-cd1f-430e-95ad-311b5b0123e7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:59.792478 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-da60338c-cd1f-430e-95ad-311b5b0123e7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:35:59.792911 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-da60338c-cd1f-430e-95ad-311b5b0123e7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:35:59.923251 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-da60338c-cd1f-430e-95ad-311b5b0123e7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:35:59.931892 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-da60338c-cd1f-430e-95ad-311b5b0123e7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14" status: 200 len: 1317 microversion: 2.1 time: 0.150802 Nov 16 00:35:59.932481 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 499/999] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:35:59 2021] GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:00.808598 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-fa0ce7a4-8702-4d17-a649-174dfc8fc55c req-8020451b-f8a9-4169-ba4f-a4b35711f558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "081f2420-eaa6-4d4c-a750-f4ca807d9d14", "name": "network-vif-plugged", "status": "completed", "tag": "d6680774-dc79-4ad5-a0f2-d8eb25c28626"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:36:00.810099 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:36:00.810099 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:36:00.816981 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-fa0ce7a4-8702-4d17-a649-174dfc8fc55c req-8020451b-f8a9-4169-ba4f-a4b35711f558 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:00.817401 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-fa0ce7a4-8702-4d17-a649-174dfc8fc55c req-8020451b-f8a9-4169-ba4f-a4b35711f558 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:00.830150 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-fa0ce7a4-8702-4d17-a649-174dfc8fc55c req-8020451b-f8a9-4169-ba4f-a4b35711f558 service nova] Creating event network-vif-plugged:d6680774-dc79-4ad5-a0f2-d8eb25c28626 for instance 081f2420-eaa6-4d4c-a750-f4ca807d9d14 on hv-cinder-81115 Nov 16 00:36:00.835351 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-fa0ce7a4-8702-4d17-a649-174dfc8fc55c req-8020451b-f8a9-4169-ba4f-a4b35711f558 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030179 Nov 16 00:36:00.835945 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 501/1000] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:36:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:36:00.949458 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-1939aee5-f34a-4978-a0dd-7282af794c26 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:00.950065 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-1939aee5-f34a-4978-a0dd-7282af794c26 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 081f2420-eaa6-4d4c-a750-f4ca807d9d14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:00.957498 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1939aee5-f34a-4978-a0dd-7282af794c26 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:00.957945 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1939aee5-f34a-4978-a0dd-7282af794c26 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:00.958736 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1939aee5-f34a-4978-a0dd-7282af794c26 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:00.959197 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1939aee5-f34a-4978-a0dd-7282af794c26 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:01.096306 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-1939aee5-f34a-4978-a0dd-7282af794c26 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:01.103895 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-1939aee5-f34a-4978-a0dd-7282af794c26 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14" status: 200 len: 1317 microversion: 2.1 time: 0.158088 Nov 16 00:36:01.104383 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 500/1001] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:00 2021] GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:02.122469 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-182665f3-ca24-44eb-b4e9-017b3f9024f0 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:02.123198 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-182665f3-ca24-44eb-b4e9-017b3f9024f0 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 081f2420-eaa6-4d4c-a750-f4ca807d9d14] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:02.130217 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-182665f3-ca24-44eb-b4e9-017b3f9024f0 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:02.130661 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-182665f3-ca24-44eb-b4e9-017b3f9024f0 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:02.131451 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-182665f3-ca24-44eb-b4e9-017b3f9024f0 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:02.131905 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-182665f3-ca24-44eb-b4e9-017b3f9024f0 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:02.259130 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-182665f3-ca24-44eb-b4e9-017b3f9024f0 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:02.266458 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-182665f3-ca24-44eb-b4e9-017b3f9024f0 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14" status: 200 len: 1317 microversion: 2.1 time: 0.148381 Nov 16 00:36:02.267082 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 502/1002] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:02 2021] GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:03.283711 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-8766c69a-41f1-40dc-9b92-43f5c4d181ab tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:03.284571 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-8766c69a-41f1-40dc-9b92-43f5c4d181ab tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 081f2420-eaa6-4d4c-a750-f4ca807d9d14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:03.290533 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8766c69a-41f1-40dc-9b92-43f5c4d181ab tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:03.290977 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8766c69a-41f1-40dc-9b92-43f5c4d181ab tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:03.291769 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8766c69a-41f1-40dc-9b92-43f5c4d181ab tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:03.292201 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8766c69a-41f1-40dc-9b92-43f5c4d181ab tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:03.422477 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-8766c69a-41f1-40dc-9b92-43f5c4d181ab tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:03.431113 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-8766c69a-41f1-40dc-9b92-43f5c4d181ab tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14" status: 200 len: 1507 microversion: 2.1 time: 0.151053 Nov 16 00:36:03.431690 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 501/1003] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:03 2021] GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:03.448369 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f9a01c69-4d93-417b-9598-07e7fa47fd1d tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b963768a-9ec4-4b1f-9d40-58b8b91635ac"}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:36:03.449412 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-f9a01c69-4d93-417b-9598-07e7fa47fd1d tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 081f2420-eaa6-4d4c-a750-f4ca807d9d14] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:03.455575 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f9a01c69-4d93-417b-9598-07e7fa47fd1d tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:03.456016 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f9a01c69-4d93-417b-9598-07e7fa47fd1d tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:03.456789 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f9a01c69-4d93-417b-9598-07e7fa47fd1d tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:03.457216 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-f9a01c69-4d93-417b-9598-07e7fa47fd1d tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:03.542917 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-f9a01c69-4d93-417b-9598-07e7fa47fd1d tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] HTTP exception thrown: Invalid volume: volume b963768a-9ec4-4b1f-9d40-58b8b91635ac is already attached to instances: 2f7f9627-db3b-428d-819b-5c5c59084942 Nov 16 00:36:03.543555 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-f9a01c69-4d93-417b-9598-07e7fa47fd1d tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Returning 400 to user: Invalid volume: volume b963768a-9ec4-4b1f-9d40-58b8b91635ac is already attached to instances: 2f7f9627-db3b-428d-819b-5c5c59084942 {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:36:03.544405 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-f9a01c69-4d93-417b-9598-07e7fa47fd1d tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "POST /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099891 Nov 16 00:36:03.544994 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 503/1004] 10.222.0.31 () {60 vars in 1322 bytes} [Tue Nov 16 00:36:03 2021] POST /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 16 00:36:03.613160 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-7bfb9280-da51-4c3b-a5cc-b4f6d8b97cf3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:03.613657 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-7bfb9280-da51-4c3b-a5cc-b4f6d8b97cf3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:03.622726 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7bfb9280-da51-4c3b-a5cc-b4f6d8b97cf3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:03.623590 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7bfb9280-da51-4c3b-a5cc-b4f6d8b97cf3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:03.624986 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7bfb9280-da51-4c3b-a5cc-b4f6d8b97cf3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:03.625759 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7bfb9280-da51-4c3b-a5cc-b4f6d8b97cf3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:03.724875 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.objects.instance [None req-7bfb9280-da51-4c3b-a5cc-b4f6d8b97cf3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lazy-loading 'services' on Instance uuid 2f7f9627-db3b-428d-819b-5c5c59084942 {{(pid=122544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:36:03.796532 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-7bfb9280-da51-4c3b-a5cc-b4f6d8b97cf3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "DELETE /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942/os-volume_attachments/b963768a-9ec4-4b1f-9d40-58b8b91635ac" status: 202 len: 0 microversion: 2.1 time: 0.187813 Nov 16 00:36:03.797325 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 502/1005] 10.222.0.31 () {58 vars in 1415 bytes} [Tue Nov 16 00:36:03 2021] DELETE /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942/os-volume_attachments/b963768a-9ec4-4b1f-9d40-58b8b91635ac => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:36:03.805868 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-34dafdb5-1fbb-45dd-b6bc-60201d0b0470 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:03.806848 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-34dafdb5-1fbb-45dd-b6bc-60201d0b0470 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:03.813216 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-34dafdb5-1fbb-45dd-b6bc-60201d0b0470 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:03.813976 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-34dafdb5-1fbb-45dd-b6bc-60201d0b0470 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:03.814897 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-34dafdb5-1fbb-45dd-b6bc-60201d0b0470 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:03.815343 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-34dafdb5-1fbb-45dd-b6bc-60201d0b0470 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:03.848703 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-34dafdb5-1fbb-45dd-b6bc-60201d0b0470 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046567 Nov 16 00:36:03.849299 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 504/1006] 10.222.0.31 () {58 vars in 1301 bytes} [Tue Nov 16 00:36:03 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:36:04.860157 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-b7950ed2-db18-422c-a0b6-e2318d883984 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:04.862055 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-b7950ed2-db18-422c-a0b6-e2318d883984 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:04.868304 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b7950ed2-db18-422c-a0b6-e2318d883984 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:04.868746 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b7950ed2-db18-422c-a0b6-e2318d883984 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:04.869510 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b7950ed2-db18-422c-a0b6-e2318d883984 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:04.869935 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b7950ed2-db18-422c-a0b6-e2318d883984 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:04.897949 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-b7950ed2-db18-422c-a0b6-e2318d883984 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041977 Nov 16 00:36:04.898500 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 503/1007] 10.222.0.31 () {58 vars in 1301 bytes} [Tue Nov 16 00:36:04 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:36:05.004319 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1ebc45b6-2406-4016-95e2-34a4a50000d4 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-793365220", "imageRef": "bb47ca05-3b48-4f1c-bc96-e0c5c672caba", "flavorRef": "452", "networks": [{"uuid": "3ade04b1-2f01-4769-9a91-0d2df635fcbb"}]}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:36:05.056095 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.network.neutron [None req-1ebc45b6-2406-4016-95e2-34a4a50000d4 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] validate_networks() for [('3ade04b1-2f01-4769-9a91-0d2df635fcbb', None, None, None, None, None)] {{(pid=122543) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:36:05.418026 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-1ebc45b6-2406-4016-95e2-34a4a50000d4 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Flavor limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:36:05.418450 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-1ebc45b6-2406-4016-95e2-34a4a50000d4 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Image limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:36:05.418920 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-1ebc45b6-2406-4016-95e2-34a4a50000d4 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Flavor pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:36:05.419374 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-1ebc45b6-2406-4016-95e2-34a4a50000d4 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Image pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:36:05.419784 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-1ebc45b6-2406-4016-95e2-34a4a50000d4 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:36:05.428418 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1ebc45b6-2406-4016-95e2-34a4a50000d4 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:05.428858 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1ebc45b6-2406-4016-95e2-34a4a50000d4 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:05.429659 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1ebc45b6-2406-4016-95e2-34a4a50000d4 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:05.430089 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1ebc45b6-2406-4016-95e2-34a4a50000d4 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:05.447890 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-1ebc45b6-2406-4016-95e2-34a4a50000d4 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Getting quotas for project 1b08090244b44b94bdedacad6778dec0. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:36:05.452411 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-1ebc45b6-2406-4016-95e2-34a4a50000d4 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Getting quotas for user facd3c2e165f495c86342ba380ca5d3b and project 1b08090244b44b94bdedacad6778dec0. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:36:05.464415 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1ebc45b6-2406-4016-95e2-34a4a50000d4 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Going to run 1 instances... {{(pid=122543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:36:05.466721 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1ebc45b6-2406-4016-95e2-34a4a50000d4 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb47ca05-3b48-4f1c-bc96-e0c5c672caba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:36:05.512139 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-1ebc45b6-2406-4016-95e2-34a4a50000d4 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511459 Nov 16 00:36:05.512684 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 505/1008] 10.222.0.31 () {60 vars in 1146 bytes} [Tue Nov 16 00:36:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 00:36:05.523396 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-84c8b69e-82b3-4d64-9e2a-f02986b506d3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:05.524033 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-84c8b69e-82b3-4d64-9e2a-f02986b506d3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:05.579476 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-84c8b69e-82b3-4d64-9e2a-f02986b506d3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:05.586055 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-84c8b69e-82b3-4d64-9e2a-f02986b506d3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa" status: 200 len: 1217 microversion: 2.1 time: 0.066383 Nov 16 00:36:05.586629 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 504/1009] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:05 2021] GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:06.607741 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-a8912e86-a072-46ee-b2f6-b93ce0b44cd8 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:06.609035 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-a8912e86-a072-46ee-b2f6-b93ce0b44cd8 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:06.616134 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a8912e86-a072-46ee-b2f6-b93ce0b44cd8 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:06.616369 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a8912e86-a072-46ee-b2f6-b93ce0b44cd8 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:06.617188 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a8912e86-a072-46ee-b2f6-b93ce0b44cd8 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:06.617797 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a8912e86-a072-46ee-b2f6-b93ce0b44cd8 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:06.691098 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-a8912e86-a072-46ee-b2f6-b93ce0b44cd8 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:06.699242 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-a8912e86-a072-46ee-b2f6-b93ce0b44cd8 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa" status: 200 len: 1287 microversion: 2.1 time: 0.095117 Nov 16 00:36:06.699813 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 506/1010] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:06 2021] GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa => generated 1287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:07.724489 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-dad2e475-afd0-40d4-9111-476d4e6c93fc tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:07.725138 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-dad2e475-afd0-40d4-9111-476d4e6c93fc tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:07.730859 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dad2e475-afd0-40d4-9111-476d4e6c93fc tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:07.731326 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dad2e475-afd0-40d4-9111-476d4e6c93fc tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:07.732090 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dad2e475-afd0-40d4-9111-476d4e6c93fc tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:07.732509 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dad2e475-afd0-40d4-9111-476d4e6c93fc tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:07.844502 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-61a59f6e-2f05-4343-85d6-2b8024d6278b req-5ccb10b9-afb7-42a5-a220-18c04f263315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d07fda4-d89e-40fa-a740-a91145df3afa", "tag": "07eae579-e284-4664-a961-8b4191f67b80"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:36:07.846350 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:36:07.846350 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:36:07.853585 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-61a59f6e-2f05-4343-85d6-2b8024d6278b req-5ccb10b9-afb7-42a5-a220-18c04f263315 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:07.854376 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-61a59f6e-2f05-4343-85d6-2b8024d6278b req-5ccb10b9-afb7-42a5-a220-18c04f263315 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:07.866015 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-61a59f6e-2f05-4343-85d6-2b8024d6278b req-5ccb10b9-afb7-42a5-a220-18c04f263315 service nova] Creating event network-changed:07eae579-e284-4664-a961-8b4191f67b80 for instance 4d07fda4-d89e-40fa-a740-a91145df3afa on hv-cinder-81115 Nov 16 00:36:07.870930 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-61a59f6e-2f05-4343-85d6-2b8024d6278b req-5ccb10b9-afb7-42a5-a220-18c04f263315 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030768 Nov 16 00:36:07.871607 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 507/1011] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:36:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:36:07.873646 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-dad2e475-afd0-40d4-9111-476d4e6c93fc tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:07.881554 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-dad2e475-afd0-40d4-9111-476d4e6c93fc tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa" status: 200 len: 1317 microversion: 2.1 time: 0.160723 Nov 16 00:36:07.882263 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 505/1012] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:07 2021] GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:08.899468 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-06099be4-a50d-4cf4-90ba-f856c517e818 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:08.900163 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-06099be4-a50d-4cf4-90ba-f856c517e818 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:08.906153 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-06099be4-a50d-4cf4-90ba-f856c517e818 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:08.906600 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-06099be4-a50d-4cf4-90ba-f856c517e818 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:08.907459 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-06099be4-a50d-4cf4-90ba-f856c517e818 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:08.907890 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-06099be4-a50d-4cf4-90ba-f856c517e818 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:09.030094 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-06099be4-a50d-4cf4-90ba-f856c517e818 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:09.037948 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-06099be4-a50d-4cf4-90ba-f856c517e818 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa" status: 200 len: 1317 microversion: 2.1 time: 0.142477 Nov 16 00:36:09.038518 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 508/1013] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:08 2021] GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:10.054541 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-5a20fa06-1709-451b-bfc3-7b415d462986 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:10.055210 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-5a20fa06-1709-451b-bfc3-7b415d462986 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:10.060997 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5a20fa06-1709-451b-bfc3-7b415d462986 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:10.061431 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5a20fa06-1709-451b-bfc3-7b415d462986 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:10.062184 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5a20fa06-1709-451b-bfc3-7b415d462986 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:10.062610 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-5a20fa06-1709-451b-bfc3-7b415d462986 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:10.190614 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-5a20fa06-1709-451b-bfc3-7b415d462986 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:10.197744 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-5a20fa06-1709-451b-bfc3-7b415d462986 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa" status: 200 len: 1317 microversion: 2.1 time: 0.146835 Nov 16 00:36:10.198311 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 506/1014] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:10 2021] GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:11.214839 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-fc722e2e-1960-40a9-b4b4-292906fe6d56 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:11.215489 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-fc722e2e-1960-40a9-b4b4-292906fe6d56 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:11.222689 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fc722e2e-1960-40a9-b4b4-292906fe6d56 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:11.223166 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fc722e2e-1960-40a9-b4b4-292906fe6d56 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:11.223953 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fc722e2e-1960-40a9-b4b4-292906fe6d56 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:11.224382 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fc722e2e-1960-40a9-b4b4-292906fe6d56 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:11.349403 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-fc722e2e-1960-40a9-b4b4-292906fe6d56 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:11.356556 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-fc722e2e-1960-40a9-b4b4-292906fe6d56 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa" status: 200 len: 1317 microversion: 2.1 time: 0.145451 Nov 16 00:36:11.357110 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 509/1015] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:11 2021] GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:12.373045 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e66c2d02-1d05-4339-be0e-d07b25efe72e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:12.373631 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e66c2d02-1d05-4339-be0e-d07b25efe72e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:12.379827 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e66c2d02-1d05-4339-be0e-d07b25efe72e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:12.380267 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e66c2d02-1d05-4339-be0e-d07b25efe72e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:12.381032 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e66c2d02-1d05-4339-be0e-d07b25efe72e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:12.381457 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e66c2d02-1d05-4339-be0e-d07b25efe72e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:12.503576 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e66c2d02-1d05-4339-be0e-d07b25efe72e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:12.510764 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e66c2d02-1d05-4339-be0e-d07b25efe72e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa" status: 200 len: 1317 microversion: 2.1 time: 0.141527 Nov 16 00:36:12.511372 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 507/1016] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:12 2021] GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:12.843517 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-e652c34a-19a8-42b2-a370-62370dfd0ec1 req-bc614655-a15f-4dd1-8fce-79451557fc97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d07fda4-d89e-40fa-a740-a91145df3afa", "name": "network-vif-plugged", "status": "completed", "tag": "07eae579-e284-4664-a961-8b4191f67b80"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:36:12.845638 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:36:12.845638 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:36:12.852435 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-e652c34a-19a8-42b2-a370-62370dfd0ec1 req-bc614655-a15f-4dd1-8fce-79451557fc97 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:12.852870 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-e652c34a-19a8-42b2-a370-62370dfd0ec1 req-bc614655-a15f-4dd1-8fce-79451557fc97 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:12.864956 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-e652c34a-19a8-42b2-a370-62370dfd0ec1 req-bc614655-a15f-4dd1-8fce-79451557fc97 service nova] Creating event network-vif-plugged:07eae579-e284-4664-a961-8b4191f67b80 for instance 4d07fda4-d89e-40fa-a740-a91145df3afa on hv-cinder-81115 Nov 16 00:36:12.869751 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-e652c34a-19a8-42b2-a370-62370dfd0ec1 req-bc614655-a15f-4dd1-8fce-79451557fc97 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029911 Nov 16 00:36:12.870338 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 510/1017] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:36:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:36:13.528147 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a851bec8-a670-4bfe-90aa-7c2bf790e6a7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:13.528785 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a851bec8-a670-4bfe-90aa-7c2bf790e6a7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:13.535668 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a851bec8-a670-4bfe-90aa-7c2bf790e6a7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:13.536105 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a851bec8-a670-4bfe-90aa-7c2bf790e6a7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:13.536883 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a851bec8-a670-4bfe-90aa-7c2bf790e6a7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:13.537306 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a851bec8-a670-4bfe-90aa-7c2bf790e6a7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:13.656579 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a851bec8-a670-4bfe-90aa-7c2bf790e6a7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:13.664732 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a851bec8-a670-4bfe-90aa-7c2bf790e6a7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa" status: 200 len: 1317 microversion: 2.1 time: 0.140243 Nov 16 00:36:13.665292 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 508/1018] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:13 2021] GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa => generated 1317 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:14.682873 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-9f1b9050-ae7c-4a73-8226-1574c309b35e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:14.683689 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-9f1b9050-ae7c-4a73-8226-1574c309b35e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:14.690319 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9f1b9050-ae7c-4a73-8226-1574c309b35e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:14.690758 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9f1b9050-ae7c-4a73-8226-1574c309b35e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:14.691627 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9f1b9050-ae7c-4a73-8226-1574c309b35e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:14.692061 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9f1b9050-ae7c-4a73-8226-1574c309b35e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:14.817748 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-9f1b9050-ae7c-4a73-8226-1574c309b35e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:14.824979 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-9f1b9050-ae7c-4a73-8226-1574c309b35e tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa" status: 200 len: 1507 microversion: 2.1 time: 0.146367 Nov 16 00:36:14.825521 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 511/1019] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:14 2021] GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:36:16.147163 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e0c6dd3e-6f20-4d8d-a73b-3ad79364c868 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21003184-b64c-4f19-98e8-4c233fed6967"}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:36:16.148218 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e0c6dd3e-6f20-4d8d-a73b-3ad79364c868 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:16.154021 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e0c6dd3e-6f20-4d8d-a73b-3ad79364c868 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:16.154469 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e0c6dd3e-6f20-4d8d-a73b-3ad79364c868 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:16.155261 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e0c6dd3e-6f20-4d8d-a73b-3ad79364c868 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:16.155696 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e0c6dd3e-6f20-4d8d-a73b-3ad79364c868 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:16.397991 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e0c6dd3e-6f20-4d8d-a73b-3ad79364c868 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "POST /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254023 Nov 16 00:36:16.399039 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 509/1020] 10.222.0.31 () {60 vars in 1322 bytes} [Tue Nov 16 00:36:16 2021] POST /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:36:23.910490 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-7edc04d2-fd6e-4f17-9161-f42ee7097f68 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21003184-b64c-4f19-98e8-4c233fed6967"}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:36:23.911575 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-7edc04d2-fd6e-4f17-9161-f42ee7097f68 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:23.917450 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7edc04d2-fd6e-4f17-9161-f42ee7097f68 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:23.917885 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7edc04d2-fd6e-4f17-9161-f42ee7097f68 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:23.918678 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7edc04d2-fd6e-4f17-9161-f42ee7097f68 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:23.919092 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7edc04d2-fd6e-4f17-9161-f42ee7097f68 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:24.000246 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-7edc04d2-fd6e-4f17-9161-f42ee7097f68 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] HTTP exception thrown: Invalid volume: volume 21003184-b64c-4f19-98e8-4c233fed6967 is already attached to instances: 4d07fda4-d89e-40fa-a740-a91145df3afa Nov 16 00:36:24.000844 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-7edc04d2-fd6e-4f17-9161-f42ee7097f68 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Returning 400 to user: Invalid volume: volume 21003184-b64c-4f19-98e8-4c233fed6967 is already attached to instances: 4d07fda4-d89e-40fa-a740-a91145df3afa {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:36:24.001917 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-7edc04d2-fd6e-4f17-9161-f42ee7097f68 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "POST /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095810 Nov 16 00:36:24.002467 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 512/1021] 10.222.0.31 () {60 vars in 1322 bytes} [Tue Nov 16 00:36:23 2021] POST /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 16 00:36:24.069480 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f9a47624-717b-46cd-8764-de42ceb0b009 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:24.070048 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f9a47624-717b-46cd-8764-de42ceb0b009 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:24.076042 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f9a47624-717b-46cd-8764-de42ceb0b009 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:24.076478 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f9a47624-717b-46cd-8764-de42ceb0b009 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:24.077226 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f9a47624-717b-46cd-8764-de42ceb0b009 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:24.077647 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f9a47624-717b-46cd-8764-de42ceb0b009 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:24.162890 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.objects.instance [None req-f9a47624-717b-46cd-8764-de42ceb0b009 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lazy-loading 'services' on Instance uuid 4d07fda4-d89e-40fa-a740-a91145df3afa {{(pid=122544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:36:24.227775 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-f9a47624-717b-46cd-8764-de42ceb0b009 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa/os-volume_attachments/21003184-b64c-4f19-98e8-4c233fed6967" status: 202 len: 0 microversion: 2.1 time: 0.162650 Nov 16 00:36:24.228343 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 510/1022] 10.222.0.31 () {58 vars in 1415 bytes} [Tue Nov 16 00:36:24 2021] DELETE /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa/os-volume_attachments/21003184-b64c-4f19-98e8-4c233fed6967 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:36:24.237313 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ce16e0f9-54c4-471e-af95-bc368a248259 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:24.238233 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ce16e0f9-54c4-471e-af95-bc368a248259 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:24.244354 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ce16e0f9-54c4-471e-af95-bc368a248259 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:24.244837 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ce16e0f9-54c4-471e-af95-bc368a248259 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:24.245919 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ce16e0f9-54c4-471e-af95-bc368a248259 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:24.246373 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ce16e0f9-54c4-471e-af95-bc368a248259 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:24.278195 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ce16e0f9-54c4-471e-af95-bc368a248259 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045235 Nov 16 00:36:24.278656 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 513/1023] 10.222.0.31 () {58 vars in 1301 bytes} [Tue Nov 16 00:36:24 2021] GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:36:25.291171 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-cc95ce50-89c2-41f1-b042-d1aa8731c9c7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:25.292254 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-cc95ce50-89c2-41f1-b042-d1aa8731c9c7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:25.298330 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cc95ce50-89c2-41f1-b042-d1aa8731c9c7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:25.299331 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cc95ce50-89c2-41f1-b042-d1aa8731c9c7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:25.300088 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cc95ce50-89c2-41f1-b042-d1aa8731c9c7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:25.300509 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cc95ce50-89c2-41f1-b042-d1aa8731c9c7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:25.328575 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-cc95ce50-89c2-41f1-b042-d1aa8731c9c7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041595 Nov 16 00:36:25.329116 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 511/1024] 10.222.0.31 () {58 vars in 1301 bytes} [Tue Nov 16 00:36:25 2021] GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:36:25.432063 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-44b2d4d8-a874-43ea-849b-73cfd6d799d3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1557517868", "imageRef": "bb47ca05-3b48-4f1c-bc96-e0c5c672caba", "flavorRef": "452", "networks": [{"uuid": "3ade04b1-2f01-4769-9a91-0d2df635fcbb"}]}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:36:25.486061 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.network.neutron [None req-44b2d4d8-a874-43ea-849b-73cfd6d799d3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] validate_networks() for [('3ade04b1-2f01-4769-9a91-0d2df635fcbb', None, None, None, None, None)] {{(pid=122543) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:36:25.848324 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-44b2d4d8-a874-43ea-849b-73cfd6d799d3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Flavor limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:36:25.848735 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-44b2d4d8-a874-43ea-849b-73cfd6d799d3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Image limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:36:25.849258 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-44b2d4d8-a874-43ea-849b-73cfd6d799d3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Flavor pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:36:25.849591 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-44b2d4d8-a874-43ea-849b-73cfd6d799d3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Image pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:36:25.849986 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-44b2d4d8-a874-43ea-849b-73cfd6d799d3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:36:25.858255 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-44b2d4d8-a874-43ea-849b-73cfd6d799d3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:25.858696 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-44b2d4d8-a874-43ea-849b-73cfd6d799d3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:25.859523 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-44b2d4d8-a874-43ea-849b-73cfd6d799d3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:25.859946 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-44b2d4d8-a874-43ea-849b-73cfd6d799d3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:25.877718 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-44b2d4d8-a874-43ea-849b-73cfd6d799d3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Getting quotas for project 1b08090244b44b94bdedacad6778dec0. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:36:25.881517 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-44b2d4d8-a874-43ea-849b-73cfd6d799d3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Getting quotas for user facd3c2e165f495c86342ba380ca5d3b and project 1b08090244b44b94bdedacad6778dec0. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:36:25.891738 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-44b2d4d8-a874-43ea-849b-73cfd6d799d3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Going to run 1 instances... {{(pid=122543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:36:25.894971 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-44b2d4d8-a874-43ea-849b-73cfd6d799d3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: aae544a0-8fa0-4269-89da-7c8cb8077b75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb47ca05-3b48-4f1c-bc96-e0c5c672caba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:36:25.939666 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-44b2d4d8-a874-43ea-849b-73cfd6d799d3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510703 Nov 16 00:36:25.940491 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 514/1025] 10.222.0.31 () {60 vars in 1146 bytes} [Tue Nov 16 00:36:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 00:36:25.949906 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-20439856-d359-4cbf-b7ee-7c2196dfc7f5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:25.950507 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-20439856-d359-4cbf-b7ee-7c2196dfc7f5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: aae544a0-8fa0-4269-89da-7c8cb8077b75] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:26.006032 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-20439856-d359-4cbf-b7ee-7c2196dfc7f5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:26.013337 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-20439856-d359-4cbf-b7ee-7c2196dfc7f5 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75" status: 200 len: 1218 microversion: 2.1 time: 0.066871 Nov 16 00:36:26.014044 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 512/1026] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:25 2021] GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:27.031931 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-34ecc125-6306-4831-8de9-1473048c3178 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:27.032473 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-34ecc125-6306-4831-8de9-1473048c3178 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: aae544a0-8fa0-4269-89da-7c8cb8077b75] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:27.040472 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-34ecc125-6306-4831-8de9-1473048c3178 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:27.040947 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-34ecc125-6306-4831-8de9-1473048c3178 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:27.041749 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-34ecc125-6306-4831-8de9-1473048c3178 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:27.042183 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-34ecc125-6306-4831-8de9-1473048c3178 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:27.111753 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-34ecc125-6306-4831-8de9-1473048c3178 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:27.119777 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-34ecc125-6306-4831-8de9-1473048c3178 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75" status: 200 len: 1288 microversion: 2.1 time: 0.092646 Nov 16 00:36:27.120501 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 515/1027] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:27 2021] GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75 => generated 1288 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:28.137280 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-2f78a573-ebc4-42ab-8ae2-399f4aa87534 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:28.137797 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-2f78a573-ebc4-42ab-8ae2-399f4aa87534 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: aae544a0-8fa0-4269-89da-7c8cb8077b75] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:28.144602 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2f78a573-ebc4-42ab-8ae2-399f4aa87534 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:28.145032 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2f78a573-ebc4-42ab-8ae2-399f4aa87534 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:28.145829 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2f78a573-ebc4-42ab-8ae2-399f4aa87534 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:28.146248 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-2f78a573-ebc4-42ab-8ae2-399f4aa87534 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:28.267034 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-31273d98-93e0-4e90-a7a8-b1d5f1b5749c req-5cbc64ed-4e76-4887-86fa-10adf7046436 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aae544a0-8fa0-4269-89da-7c8cb8077b75", "tag": "1d23cd09-afd7-4f7b-ae76-74475e8fb942"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:36:28.270543 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:36:28.270543 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:36:28.288100 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-2f78a573-ebc4-42ab-8ae2-399f4aa87534 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:28.290932 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-31273d98-93e0-4e90-a7a8-b1d5f1b5749c req-5cbc64ed-4e76-4887-86fa-10adf7046436 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:28.291419 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-31273d98-93e0-4e90-a7a8-b1d5f1b5749c req-5cbc64ed-4e76-4887-86fa-10adf7046436 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:28.295739 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-2f78a573-ebc4-42ab-8ae2-399f4aa87534 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75" status: 200 len: 1318 microversion: 2.1 time: 0.162471 Nov 16 00:36:28.296625 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 513/1028] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:28 2021] GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:28.304042 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-31273d98-93e0-4e90-a7a8-b1d5f1b5749c req-5cbc64ed-4e76-4887-86fa-10adf7046436 service nova] Creating event network-changed:1d23cd09-afd7-4f7b-ae76-74475e8fb942 for instance aae544a0-8fa0-4269-89da-7c8cb8077b75 on hv-cinder-81115 Nov 16 00:36:28.309142 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-31273d98-93e0-4e90-a7a8-b1d5f1b5749c req-5cbc64ed-4e76-4887-86fa-10adf7046436 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047847 Nov 16 00:36:28.309868 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 516/1029] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:36:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:36:29.313632 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-9d2dd779-5ada-444d-9c3f-f700dd97ea12 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:29.314279 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-9d2dd779-5ada-444d-9c3f-f700dd97ea12 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: aae544a0-8fa0-4269-89da-7c8cb8077b75] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:29.320075 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9d2dd779-5ada-444d-9c3f-f700dd97ea12 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:29.320510 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9d2dd779-5ada-444d-9c3f-f700dd97ea12 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:29.321272 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9d2dd779-5ada-444d-9c3f-f700dd97ea12 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:29.321697 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9d2dd779-5ada-444d-9c3f-f700dd97ea12 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:29.446344 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-9d2dd779-5ada-444d-9c3f-f700dd97ea12 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:29.455292 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-9d2dd779-5ada-444d-9c3f-f700dd97ea12 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75" status: 200 len: 1318 microversion: 2.1 time: 0.144787 Nov 16 00:36:29.456529 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 514/1030] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:29 2021] GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:30.474819 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8e5ac555-e0f7-452f-a661-e432c7739246 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:30.475571 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8e5ac555-e0f7-452f-a661-e432c7739246 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: aae544a0-8fa0-4269-89da-7c8cb8077b75] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:30.481614 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8e5ac555-e0f7-452f-a661-e432c7739246 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:30.482049 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8e5ac555-e0f7-452f-a661-e432c7739246 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:30.482797 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8e5ac555-e0f7-452f-a661-e432c7739246 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:30.483251 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8e5ac555-e0f7-452f-a661-e432c7739246 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:30.607621 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-8e5ac555-e0f7-452f-a661-e432c7739246 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:30.615640 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8e5ac555-e0f7-452f-a661-e432c7739246 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75" status: 200 len: 1318 microversion: 2.1 time: 0.145945 Nov 16 00:36:30.616193 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 517/1031] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:30 2021] GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:31.633028 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-dcaaf70a-2f8d-4207-9a04-17fc895fb629 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:31.633549 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-dcaaf70a-2f8d-4207-9a04-17fc895fb629 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: aae544a0-8fa0-4269-89da-7c8cb8077b75] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:31.639432 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dcaaf70a-2f8d-4207-9a04-17fc895fb629 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:31.639873 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dcaaf70a-2f8d-4207-9a04-17fc895fb629 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:31.640639 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dcaaf70a-2f8d-4207-9a04-17fc895fb629 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:31.641066 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dcaaf70a-2f8d-4207-9a04-17fc895fb629 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:31.765590 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-dcaaf70a-2f8d-4207-9a04-17fc895fb629 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:31.772893 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-dcaaf70a-2f8d-4207-9a04-17fc895fb629 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75" status: 200 len: 1318 microversion: 2.1 time: 0.143610 Nov 16 00:36:31.773455 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 515/1032] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:31 2021] GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:32.789977 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-14f701c4-9d6d-4faa-9606-e6c427db32d7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:32.790573 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-14f701c4-9d6d-4faa-9606-e6c427db32d7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: aae544a0-8fa0-4269-89da-7c8cb8077b75] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:32.796349 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-14f701c4-9d6d-4faa-9606-e6c427db32d7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:32.796783 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-14f701c4-9d6d-4faa-9606-e6c427db32d7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:32.797531 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-14f701c4-9d6d-4faa-9606-e6c427db32d7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:32.797955 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-14f701c4-9d6d-4faa-9606-e6c427db32d7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:32.920188 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-14f701c4-9d6d-4faa-9606-e6c427db32d7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:32.927924 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-14f701c4-9d6d-4faa-9606-e6c427db32d7 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75" status: 200 len: 1318 microversion: 2.1 time: 0.141609 Nov 16 00:36:32.928486 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 518/1033] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:32 2021] GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:32.992222 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-44d876f3-a45d-4a43-a83f-517ce6c02cce req-972f5e97-9d09-4276-a78e-5e90644e343e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae544a0-8fa0-4269-89da-7c8cb8077b75", "name": "network-vif-plugged", "status": "completed", "tag": "1d23cd09-afd7-4f7b-ae76-74475e8fb942"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:36:32.993722 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:36:32.993722 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:36:33.002927 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-44d876f3-a45d-4a43-a83f-517ce6c02cce req-972f5e97-9d09-4276-a78e-5e90644e343e service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:33.003680 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-44d876f3-a45d-4a43-a83f-517ce6c02cce req-972f5e97-9d09-4276-a78e-5e90644e343e service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:33.015366 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-44d876f3-a45d-4a43-a83f-517ce6c02cce req-972f5e97-9d09-4276-a78e-5e90644e343e service nova] Creating event network-vif-plugged:1d23cd09-afd7-4f7b-ae76-74475e8fb942 for instance aae544a0-8fa0-4269-89da-7c8cb8077b75 on hv-cinder-81115 Nov 16 00:36:33.020430 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-44d876f3-a45d-4a43-a83f-517ce6c02cce req-972f5e97-9d09-4276-a78e-5e90644e343e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032065 Nov 16 00:36:33.021262 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 516/1034] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:36:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:36:33.944995 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8cb6cfb2-5323-406e-b2b0-1c23260c7701 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:33.945526 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8cb6cfb2-5323-406e-b2b0-1c23260c7701 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: aae544a0-8fa0-4269-89da-7c8cb8077b75] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:33.951192 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8cb6cfb2-5323-406e-b2b0-1c23260c7701 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:33.951628 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8cb6cfb2-5323-406e-b2b0-1c23260c7701 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:33.952376 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8cb6cfb2-5323-406e-b2b0-1c23260c7701 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:33.952797 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8cb6cfb2-5323-406e-b2b0-1c23260c7701 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:34.075577 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-8cb6cfb2-5323-406e-b2b0-1c23260c7701 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:34.083490 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8cb6cfb2-5323-406e-b2b0-1c23260c7701 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75" status: 200 len: 1318 microversion: 2.1 time: 0.141959 Nov 16 00:36:34.084048 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 519/1035] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:33 2021] GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:35.101167 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-ea80a351-825d-45c0-a2cc-3a79a8f7b454 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:35.101864 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-ea80a351-825d-45c0-a2cc-3a79a8f7b454 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: aae544a0-8fa0-4269-89da-7c8cb8077b75] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:35.108016 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ea80a351-825d-45c0-a2cc-3a79a8f7b454 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:35.108462 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ea80a351-825d-45c0-a2cc-3a79a8f7b454 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:35.109225 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ea80a351-825d-45c0-a2cc-3a79a8f7b454 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:35.109654 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ea80a351-825d-45c0-a2cc-3a79a8f7b454 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:35.232507 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-ea80a351-825d-45c0-a2cc-3a79a8f7b454 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:35.239739 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-ea80a351-825d-45c0-a2cc-3a79a8f7b454 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75" status: 200 len: 1509 microversion: 2.1 time: 0.142566 Nov 16 00:36:35.240296 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 517/1036] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:35 2021] GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75 => generated 1509 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:36.564208 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-2bf5039a-81a3-44aa-8a75-6d8ddbc95207 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec527569-858d-42df-a5be-90a666563757"}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:36:36.565461 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-2bf5039a-81a3-44aa-8a75-6d8ddbc95207 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: aae544a0-8fa0-4269-89da-7c8cb8077b75] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:36.571293 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2bf5039a-81a3-44aa-8a75-6d8ddbc95207 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:36.571728 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2bf5039a-81a3-44aa-8a75-6d8ddbc95207 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:36.572484 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2bf5039a-81a3-44aa-8a75-6d8ddbc95207 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:36.572907 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2bf5039a-81a3-44aa-8a75-6d8ddbc95207 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:36.811919 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-2bf5039a-81a3-44aa-8a75-6d8ddbc95207 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "POST /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251297 Nov 16 00:36:36.812516 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 520/1037] 10.222.0.31 () {60 vars in 1322 bytes} [Tue Nov 16 00:36:36 2021] POST /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:36:37.346866 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0515f6d5-daa6-424d-94f3-e11e888d1448 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:37.347800 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0515f6d5-daa6-424d-94f3-e11e888d1448 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:37.354232 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0515f6d5-daa6-424d-94f3-e11e888d1448 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:37.354687 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0515f6d5-daa6-424d-94f3-e11e888d1448 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:37.355492 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0515f6d5-daa6-424d-94f3-e11e888d1448 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:37.355922 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0515f6d5-daa6-424d-94f3-e11e888d1448 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:37.385161 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0515f6d5-daa6-424d-94f3-e11e888d1448 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042148 Nov 16 00:36:37.385758 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 518/1038] 10.222.0.31 () {60 vars in 1342 bytes} [Tue Nov 16 00:36:37 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:37.447755 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c49fe9a0-8c1f-4eaf-801e-675cb4a0c88d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:37.448335 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c49fe9a0-8c1f-4eaf-801e-675cb4a0c88d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:37.454306 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c49fe9a0-8c1f-4eaf-801e-675cb4a0c88d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:37.454749 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c49fe9a0-8c1f-4eaf-801e-675cb4a0c88d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:37.455902 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c49fe9a0-8c1f-4eaf-801e-675cb4a0c88d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:37.456353 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c49fe9a0-8c1f-4eaf-801e-675cb4a0c88d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:37.481503 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c49fe9a0-8c1f-4eaf-801e-675cb4a0c88d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Going to try to terminate instance {{(pid=122543) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:36:37.555934 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c49fe9a0-8c1f-4eaf-801e-675cb4a0c88d tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 204 len: 0 microversion: 2.20 time: 0.112199 Nov 16 00:36:37.557802 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 521/1039] 10.222.0.31 () {60 vars in 1279 bytes} [Tue Nov 16 00:36:37 2021] DELETE /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 16 00:36:37.566101 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e83b4748-4ae7-496e-a1f2-3d8f8f972075 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:37.566808 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e83b4748-4ae7-496e-a1f2-3d8f8f972075 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:37.577827 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e83b4748-4ae7-496e-a1f2-3d8f8f972075 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:37.578290 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e83b4748-4ae7-496e-a1f2-3d8f8f972075 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:37.579086 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e83b4748-4ae7-496e-a1f2-3d8f8f972075 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:37.579517 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e83b4748-4ae7-496e-a1f2-3d8f8f972075 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:37.702897 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e83b4748-4ae7-496e-a1f2-3d8f8f972075 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:37.710630 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e83b4748-4ae7-496e-a1f2-3d8f8f972075 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:37.712128 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-e83b4748-4ae7-496e-a1f2-3d8f8f972075 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:37.713452 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e83b4748-4ae7-496e-a1f2-3d8f8f972075 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1723 microversion: 2.20 time: 0.152425 Nov 16 00:36:37.714010 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 519/1040] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:36:37 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:36:38.733175 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-0413ad0a-f5a9-4f2d-a964-1fa73e3e14e0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:38.733774 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-0413ad0a-f5a9-4f2d-a964-1fa73e3e14e0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:38.740584 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0413ad0a-f5a9-4f2d-a964-1fa73e3e14e0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:38.741019 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0413ad0a-f5a9-4f2d-a964-1fa73e3e14e0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:38.741774 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0413ad0a-f5a9-4f2d-a964-1fa73e3e14e0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:38.742199 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-0413ad0a-f5a9-4f2d-a964-1fa73e3e14e0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:38.868151 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-0413ad0a-f5a9-4f2d-a964-1fa73e3e14e0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:38.875695 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-0413ad0a-f5a9-4f2d-a964-1fa73e3e14e0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:38.877708 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-0413ad0a-f5a9-4f2d-a964-1fa73e3e14e0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:38.878854 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-0413ad0a-f5a9-4f2d-a964-1fa73e3e14e0 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1723 microversion: 2.20 time: 0.149850 Nov 16 00:36:38.879431 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 522/1041] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:36:38 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:36:39.896992 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-667e1d0f-8158-47d2-a78e-d6236e3d0eca tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:39.897607 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-667e1d0f-8158-47d2-a78e-d6236e3d0eca tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:39.903674 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-667e1d0f-8158-47d2-a78e-d6236e3d0eca tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:39.904119 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-667e1d0f-8158-47d2-a78e-d6236e3d0eca tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:39.904893 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-667e1d0f-8158-47d2-a78e-d6236e3d0eca tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:39.905322 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-667e1d0f-8158-47d2-a78e-d6236e3d0eca tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:39.967078 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-667e1d0f-8158-47d2-a78e-d6236e3d0eca tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:39.975445 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-667e1d0f-8158-47d2-a78e-d6236e3d0eca tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:39.977097 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-667e1d0f-8158-47d2-a78e-d6236e3d0eca tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9913646689d4e678fbb35098466ec8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a41a4472a974da5aee5d6b458d9f619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:39.978272 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-667e1d0f-8158-47d2-a78e-d6236e3d0eca tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 200 len: 1655 microversion: 2.20 time: 0.085040 Nov 16 00:36:39.984259 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 520/1042] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:36:39 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 1655 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 00:36:40.029187 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-9a1656b5-d717-41af-b53c-d6f5d726453b req-77243909-672f-4ee3-80f2-57dc4ba9146e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cabac73-4f43-4f58-941d-fcde21d2fdf2", "name": "network-vif-deleted", "tag": "24c138f4-ee49-4e30-8553-2bc8c5029b8d"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:36:40.030615 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:36:40.030615 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:36:40.040011 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-9a1656b5-d717-41af-b53c-d6f5d726453b req-77243909-672f-4ee3-80f2-57dc4ba9146e service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:40.040534 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-9a1656b5-d717-41af-b53c-d6f5d726453b req-77243909-672f-4ee3-80f2-57dc4ba9146e service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:40.055409 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-9a1656b5-d717-41af-b53c-d6f5d726453b req-77243909-672f-4ee3-80f2-57dc4ba9146e service nova] Creating event network-vif-deleted:24c138f4-ee49-4e30-8553-2bc8c5029b8d for instance 5cabac73-4f43-4f58-941d-fcde21d2fdf2 on hv-cinder-81115 Nov 16 00:36:40.060261 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-9a1656b5-d717-41af-b53c-d6f5d726453b req-77243909-672f-4ee3-80f2-57dc4ba9146e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034971 Nov 16 00:36:40.060850 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 523/1043] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:36:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:36:40.997001 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-48c5e4b8-cbf8-4167-a72e-e7d884b02ef5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:40.997427 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-48c5e4b8-cbf8-4167-a72e-e7d884b02ef5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:41.004424 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-48c5e4b8-cbf8-4167-a72e-e7d884b02ef5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:41.004872 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-48c5e4b8-cbf8-4167-a72e-e7d884b02ef5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:41.005648 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-48c5e4b8-cbf8-4167-a72e-e7d884b02ef5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:41.006081 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-48c5e4b8-cbf8-4167-a72e-e7d884b02ef5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:41.020090 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-48c5e4b8-cbf8-4167-a72e-e7d884b02ef5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] HTTP exception thrown: Instance 5cabac73-4f43-4f58-941d-fcde21d2fdf2 could not be found. Nov 16 00:36:41.020682 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-48c5e4b8-cbf8-4167-a72e-e7d884b02ef5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Returning 404 to user: Instance 5cabac73-4f43-4f58-941d-fcde21d2fdf2 could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:36:41.021514 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-48c5e4b8-cbf8-4167-a72e-e7d884b02ef5 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 404 len: 111 microversion: 2.20 time: 0.028448 Nov 16 00:36:41.022052 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 521/1044] 10.222.0.31 () {60 vars in 1276 bytes} [Tue Nov 16 00:36:40 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 16 00:36:41.031402 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-88896f6d-92e4-4e54-a929-8a84a0a59422 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '.version_select at 0x7f2f2e3fe310>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:41.049254 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-88896f6d-92e4-4e54-a929-8a84a0a59422 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-565094471" status: 204 len: 0 microversion: 2.20 time: 0.022402 Nov 16 00:36:41.049820 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 524/1045] 10.222.0.31 () {60 vars in 1258 bytes} [Tue Nov 16 00:36:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-565094471 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 16 00:36:42.850027 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-b19ff461-4a51-4a35-8b16-79f300fe277e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:42.850542 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-b19ff461-4a51-4a35-8b16-79f300fe277e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:42.856364 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b19ff461-4a51-4a35-8b16-79f300fe277e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:42.856803 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b19ff461-4a51-4a35-8b16-79f300fe277e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:42.857571 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b19ff461-4a51-4a35-8b16-79f300fe277e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:42.858000 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b19ff461-4a51-4a35-8b16-79f300fe277e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:42.871738 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-b19ff461-4a51-4a35-8b16-79f300fe277e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] HTTP exception thrown: Instance 5cabac73-4f43-4f58-941d-fcde21d2fdf2 could not be found. Nov 16 00:36:42.872354 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-b19ff461-4a51-4a35-8b16-79f300fe277e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Returning 404 to user: Instance 5cabac73-4f43-4f58-941d-fcde21d2fdf2 could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:36:42.873145 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-b19ff461-4a51-4a35-8b16-79f300fe277e tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 404 len: 111 microversion: 2.1 time: 0.027564 Nov 16 00:36:42.873697 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 522/1046] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:36:42 2021] DELETE /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:36:42.881396 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-65b8c6ff-e4b5-4937-80ed-619577b307a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:42.882115 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-65b8c6ff-e4b5-4937-80ed-619577b307a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 5cabac73-4f43-4f58-941d-fcde21d2fdf2] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:42.889271 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-65b8c6ff-e4b5-4937-80ed-619577b307a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:42.889763 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-65b8c6ff-e4b5-4937-80ed-619577b307a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:42.890706 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-65b8c6ff-e4b5-4937-80ed-619577b307a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:42.891173 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-65b8c6ff-e4b5-4937-80ed-619577b307a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:42.906730 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-65b8c6ff-e4b5-4937-80ed-619577b307a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] HTTP exception thrown: Instance 5cabac73-4f43-4f58-941d-fcde21d2fdf2 could not be found. Nov 16 00:36:42.907351 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-65b8c6ff-e4b5-4937-80ed-619577b307a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Returning 404 to user: Instance 5cabac73-4f43-4f58-941d-fcde21d2fdf2 could not be found. {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:36:42.909228 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-65b8c6ff-e4b5-4937-80ed-619577b307a2 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2" status: 404 len: 111 microversion: 2.1 time: 0.030383 Nov 16 00:36:42.909770 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 525/1047] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:42 2021] GET /compute/v2.1/servers/5cabac73-4f43-4f58-941d-fcde21d2fdf2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 00:36:44.050195 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-299cddf5-3abb-4e84-92de-1a832281adeb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:44.050942 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-299cddf5-3abb-4e84-92de-1a832281adeb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:44.057151 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-299cddf5-3abb-4e84-92de-1a832281adeb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:44.059120 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-299cddf5-3abb-4e84-92de-1a832281adeb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:44.059120 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-299cddf5-3abb-4e84-92de-1a832281adeb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:44.059120 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-299cddf5-3abb-4e84-92de-1a832281adeb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:44.072865 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-299cddf5-3abb-4e84-92de-1a832281adeb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] HTTP exception thrown: Instance 3f9b823f-75c2-4baf-9577-5dc85ec77405 could not be found. Nov 16 00:36:44.073438 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-299cddf5-3abb-4e84-92de-1a832281adeb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Returning 404 to user: Instance 3f9b823f-75c2-4baf-9577-5dc85ec77405 could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:36:44.074286 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-299cddf5-3abb-4e84-92de-1a832281adeb tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "DELETE /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 404 len: 111 microversion: 2.1 time: 0.028511 Nov 16 00:36:44.074835 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 523/1048] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:36:44 2021] DELETE /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:36:44.083741 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-15b54bdd-5309-462e-8f61-3f8d39dc9985 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:44.084501 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-15b54bdd-5309-462e-8f61-3f8d39dc9985 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] [instance: 3f9b823f-75c2-4baf-9577-5dc85ec77405] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:44.091631 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-15b54bdd-5309-462e-8f61-3f8d39dc9985 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:44.092755 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-15b54bdd-5309-462e-8f61-3f8d39dc9985 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:44.093583 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-15b54bdd-5309-462e-8f61-3f8d39dc9985 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:44.094013 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-15b54bdd-5309-462e-8f61-3f8d39dc9985 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:44.109439 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-15b54bdd-5309-462e-8f61-3f8d39dc9985 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] HTTP exception thrown: Instance 3f9b823f-75c2-4baf-9577-5dc85ec77405 could not be found. Nov 16 00:36:44.110026 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-15b54bdd-5309-462e-8f61-3f8d39dc9985 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] Returning 404 to user: Instance 3f9b823f-75c2-4baf-9577-5dc85ec77405 could not be found. {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:36:44.110856 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-15b54bdd-5309-462e-8f61-3f8d39dc9985 tempest-AttachVolumeShelveTestJSON-1434524064 tempest-AttachVolumeShelveTestJSON-1434524064-project] 10.222.0.31 "GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405" status: 404 len: 111 microversion: 2.1 time: 0.031568 Nov 16 00:36:44.112020 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 526/1049] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:44 2021] GET /compute/v2.1/servers/3f9b823f-75c2-4baf-9577-5dc85ec77405 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 00:36:44.469147 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e7c9cdd2-2a53-48b5-87b3-78b6a8a88003 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:44.469690 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e7c9cdd2-2a53-48b5-87b3-78b6a8a88003 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: aae544a0-8fa0-4269-89da-7c8cb8077b75] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:44.475988 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e7c9cdd2-2a53-48b5-87b3-78b6a8a88003 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:44.476419 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e7c9cdd2-2a53-48b5-87b3-78b6a8a88003 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:44.477175 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e7c9cdd2-2a53-48b5-87b3-78b6a8a88003 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:44.477589 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e7c9cdd2-2a53-48b5-87b3-78b6a8a88003 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:44.566748 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.objects.instance [None req-e7c9cdd2-2a53-48b5-87b3-78b6a8a88003 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lazy-loading 'services' on Instance uuid aae544a0-8fa0-4269-89da-7c8cb8077b75 {{(pid=122544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:36:44.632745 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e7c9cdd2-2a53-48b5-87b3-78b6a8a88003 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "DELETE /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75/os-volume_attachments/ec527569-858d-42df-a5be-90a666563757" status: 202 len: 0 microversion: 2.1 time: 0.167229 Nov 16 00:36:44.633773 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 524/1050] 10.222.0.31 () {58 vars in 1415 bytes} [Tue Nov 16 00:36:44 2021] DELETE /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75/os-volume_attachments/ec527569-858d-42df-a5be-90a666563757 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:36:44.642885 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-8e6852b9-3c35-4ece-a32b-6239c772d678 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:44.643979 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-8e6852b9-3c35-4ece-a32b-6239c772d678 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: aae544a0-8fa0-4269-89da-7c8cb8077b75] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:44.650192 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8e6852b9-3c35-4ece-a32b-6239c772d678 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:44.650891 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8e6852b9-3c35-4ece-a32b-6239c772d678 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:44.651843 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8e6852b9-3c35-4ece-a32b-6239c772d678 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:44.652649 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-8e6852b9-3c35-4ece-a32b-6239c772d678 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:44.687668 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-8e6852b9-3c35-4ece-a32b-6239c772d678 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049283 Nov 16 00:36:44.688369 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 527/1051] 10.222.0.31 () {58 vars in 1301 bytes} [Tue Nov 16 00:36:44 2021] GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:36:45.700897 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-796065ee-7aac-48cd-b121-be2b82aaa500 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:45.702180 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-796065ee-7aac-48cd-b121-be2b82aaa500 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: aae544a0-8fa0-4269-89da-7c8cb8077b75] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:45.709151 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-796065ee-7aac-48cd-b121-be2b82aaa500 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:45.709598 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-796065ee-7aac-48cd-b121-be2b82aaa500 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:45.710383 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-796065ee-7aac-48cd-b121-be2b82aaa500 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:45.710809 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-796065ee-7aac-48cd-b121-be2b82aaa500 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:45.758230 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-796065ee-7aac-48cd-b121-be2b82aaa500 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061467 Nov 16 00:36:45.759017 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 525/1052] 10.222.0.31 () {58 vars in 1301 bytes} [Tue Nov 16 00:36:45 2021] GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 00:36:46.981271 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-10c11755-6192-47a3-9bb9-e588be02c194 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:46.982379 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-10c11755-6192-47a3-9bb9-e588be02c194 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: aae544a0-8fa0-4269-89da-7c8cb8077b75] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:46.990153 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-10c11755-6192-47a3-9bb9-e588be02c194 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:46.990598 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-10c11755-6192-47a3-9bb9-e588be02c194 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:46.991410 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-10c11755-6192-47a3-9bb9-e588be02c194 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:46.991839 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-10c11755-6192-47a3-9bb9-e588be02c194 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:47.025255 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-10c11755-6192-47a3-9bb9-e588be02c194 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: aae544a0-8fa0-4269-89da-7c8cb8077b75] Going to try to terminate instance {{(pid=122543) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:36:47.112968 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-10c11755-6192-47a3-9bb9-e588be02c194 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "DELETE /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75" status: 204 len: 0 microversion: 2.1 time: 0.135216 Nov 16 00:36:47.113869 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 528/1053] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:36:46 2021] DELETE /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 00:36:47.121698 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-1e9dceba-3a68-46e9-b6b6-393ae69e3455 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:47.122302 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-1e9dceba-3a68-46e9-b6b6-393ae69e3455 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: aae544a0-8fa0-4269-89da-7c8cb8077b75] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:47.135292 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1e9dceba-3a68-46e9-b6b6-393ae69e3455 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:47.135804 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1e9dceba-3a68-46e9-b6b6-393ae69e3455 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:47.136900 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1e9dceba-3a68-46e9-b6b6-393ae69e3455 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:47.137380 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1e9dceba-3a68-46e9-b6b6-393ae69e3455 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:47.370692 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-1e9dceba-3a68-46e9-b6b6-393ae69e3455 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:47.382085 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-1e9dceba-3a68-46e9-b6b6-393ae69e3455 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75" status: 200 len: 1515 microversion: 2.1 time: 0.263714 Nov 16 00:36:47.384144 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 526/1054] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:47 2021] GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75 => generated 1515 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:48.401360 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-7970c448-8c8a-4952-8229-b7714efe6b0f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:48.402629 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-7970c448-8c8a-4952-8229-b7714efe6b0f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: aae544a0-8fa0-4269-89da-7c8cb8077b75] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:48.409332 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7970c448-8c8a-4952-8229-b7714efe6b0f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:48.409781 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7970c448-8c8a-4952-8229-b7714efe6b0f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:48.410583 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7970c448-8c8a-4952-8229-b7714efe6b0f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:48.411015 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7970c448-8c8a-4952-8229-b7714efe6b0f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:48.544717 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-7970c448-8c8a-4952-8229-b7714efe6b0f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:48.552677 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-7970c448-8c8a-4952-8229-b7714efe6b0f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75" status: 200 len: 1515 microversion: 2.1 time: 0.155827 Nov 16 00:36:48.553424 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 529/1055] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:48 2021] GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:36:49.570560 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d7c05783-d44d-4ec9-a163-86bde3d26599 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:49.571329 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d7c05783-d44d-4ec9-a163-86bde3d26599 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: aae544a0-8fa0-4269-89da-7c8cb8077b75] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:49.577623 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d7c05783-d44d-4ec9-a163-86bde3d26599 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:49.578312 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d7c05783-d44d-4ec9-a163-86bde3d26599 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:49.579338 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d7c05783-d44d-4ec9-a163-86bde3d26599 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:49.580594 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d7c05783-d44d-4ec9-a163-86bde3d26599 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:49.655998 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d7c05783-d44d-4ec9-a163-86bde3d26599 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:49.665640 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d7c05783-d44d-4ec9-a163-86bde3d26599 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75" status: 200 len: 1473 microversion: 2.1 time: 0.099253 Nov 16 00:36:49.666499 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 527/1056] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:49 2021] GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75 => generated 1473 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:49.697293 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-7861052e-6359-4304-b698-33b25eaccf5c req-bfd26b54-f12d-4037-953d-aeec79f2b67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae544a0-8fa0-4269-89da-7c8cb8077b75", "name": "network-vif-deleted", "tag": "1d23cd09-afd7-4f7b-ae76-74475e8fb942"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:36:49.700050 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:36:49.700050 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:36:49.710511 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-7861052e-6359-4304-b698-33b25eaccf5c req-bfd26b54-f12d-4037-953d-aeec79f2b67c service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:49.711796 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-7861052e-6359-4304-b698-33b25eaccf5c req-bfd26b54-f12d-4037-953d-aeec79f2b67c service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:49.729784 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-7861052e-6359-4304-b698-33b25eaccf5c req-bfd26b54-f12d-4037-953d-aeec79f2b67c service nova] Creating event network-vif-deleted:1d23cd09-afd7-4f7b-ae76-74475e8fb942 for instance aae544a0-8fa0-4269-89da-7c8cb8077b75 on hv-cinder-81115 Nov 16 00:36:49.735499 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-7861052e-6359-4304-b698-33b25eaccf5c req-bfd26b54-f12d-4037-953d-aeec79f2b67c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043636 Nov 16 00:36:49.736989 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 530/1057] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:36:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:36:50.682910 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-cff22d8a-3010-4f21-9ba6-6e8e9ffc2aa1 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:50.683564 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-cff22d8a-3010-4f21-9ba6-6e8e9ffc2aa1 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: aae544a0-8fa0-4269-89da-7c8cb8077b75] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:50.690587 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cff22d8a-3010-4f21-9ba6-6e8e9ffc2aa1 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:50.691536 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cff22d8a-3010-4f21-9ba6-6e8e9ffc2aa1 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:50.692344 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cff22d8a-3010-4f21-9ba6-6e8e9ffc2aa1 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:50.692773 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cff22d8a-3010-4f21-9ba6-6e8e9ffc2aa1 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:50.707501 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-cff22d8a-3010-4f21-9ba6-6e8e9ffc2aa1 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] HTTP exception thrown: Instance aae544a0-8fa0-4269-89da-7c8cb8077b75 could not be found. Nov 16 00:36:50.708091 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-cff22d8a-3010-4f21-9ba6-6e8e9ffc2aa1 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Returning 404 to user: Instance aae544a0-8fa0-4269-89da-7c8cb8077b75 could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:36:50.708909 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-cff22d8a-3010-4f21-9ba6-6e8e9ffc2aa1 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75" status: 404 len: 111 microversion: 2.1 time: 0.029730 Nov 16 00:36:50.709452 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 528/1058] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:50 2021] GET /compute/v2.1/servers/aae544a0-8fa0-4269-89da-7c8cb8077b75 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:36:51.847540 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-fc6b964e-6865-471e-a8a8-560057ccfe2f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:51.848204 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-fc6b964e-6865-471e-a8a8-560057ccfe2f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:51.854169 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fc6b964e-6865-471e-a8a8-560057ccfe2f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:51.854610 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fc6b964e-6865-471e-a8a8-560057ccfe2f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:51.855424 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fc6b964e-6865-471e-a8a8-560057ccfe2f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:51.855845 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-fc6b964e-6865-471e-a8a8-560057ccfe2f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:51.882271 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-fc6b964e-6865-471e-a8a8-560057ccfe2f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] Going to try to terminate instance {{(pid=122543) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:36:51.960638 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-fc6b964e-6865-471e-a8a8-560057ccfe2f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa" status: 204 len: 0 microversion: 2.1 time: 0.116796 Nov 16 00:36:51.961387 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 531/1059] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:36:51 2021] DELETE /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 00:36:51.969952 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a52ea591-ac2d-4f66-8ba1-6c79caa33e8f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:51.970558 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a52ea591-ac2d-4f66-8ba1-6c79caa33e8f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:51.977123 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a52ea591-ac2d-4f66-8ba1-6c79caa33e8f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:51.977636 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a52ea591-ac2d-4f66-8ba1-6c79caa33e8f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:51.978477 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a52ea591-ac2d-4f66-8ba1-6c79caa33e8f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:51.978975 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a52ea591-ac2d-4f66-8ba1-6c79caa33e8f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:52.106710 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a52ea591-ac2d-4f66-8ba1-6c79caa33e8f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:52.114192 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a52ea591-ac2d-4f66-8ba1-6c79caa33e8f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa" status: 200 len: 1513 microversion: 2.1 time: 0.148173 Nov 16 00:36:52.114758 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 529/1060] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:51 2021] GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:53.132309 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-725157b2-5374-4cd0-b958-0ac7be93539a tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:53.132999 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-725157b2-5374-4cd0-b958-0ac7be93539a tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:53.138828 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-725157b2-5374-4cd0-b958-0ac7be93539a tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:53.139300 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-725157b2-5374-4cd0-b958-0ac7be93539a tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:53.140062 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-725157b2-5374-4cd0-b958-0ac7be93539a tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:53.140485 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-725157b2-5374-4cd0-b958-0ac7be93539a tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:53.268123 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-725157b2-5374-4cd0-b958-0ac7be93539a tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:53.275844 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-725157b2-5374-4cd0-b958-0ac7be93539a tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa" status: 200 len: 1513 microversion: 2.1 time: 0.148139 Nov 16 00:36:53.276421 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 532/1061] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:53 2021] GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:54.242054 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-bc508035-9746-4eeb-ad91-05ce9bc24c75 req-136e3322-32dd-41b4-8496-a8b430c2148a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d07fda4-d89e-40fa-a740-a91145df3afa", "name": "network-vif-deleted", "tag": "07eae579-e284-4664-a961-8b4191f67b80"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:36:54.243627 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:36:54.243627 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:36:54.254434 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-bc508035-9746-4eeb-ad91-05ce9bc24c75 req-136e3322-32dd-41b4-8496-a8b430c2148a service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:54.255117 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-bc508035-9746-4eeb-ad91-05ce9bc24c75 req-136e3322-32dd-41b4-8496-a8b430c2148a service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:54.267225 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-bc508035-9746-4eeb-ad91-05ce9bc24c75 req-136e3322-32dd-41b4-8496-a8b430c2148a service nova] Creating event network-vif-deleted:07eae579-e284-4664-a961-8b4191f67b80 for instance 4d07fda4-d89e-40fa-a740-a91145df3afa on hv-cinder-81115 Nov 16 00:36:54.273675 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-bc508035-9746-4eeb-ad91-05ce9bc24c75 req-136e3322-32dd-41b4-8496-a8b430c2148a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035512 Nov 16 00:36:54.274752 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 530/1062] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:36:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:36:54.294166 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-9395cb83-7bf4-4b3b-8baa-647f0a1dc148 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:54.295619 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-9395cb83-7bf4-4b3b-8baa-647f0a1dc148 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:54.304518 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9395cb83-7bf4-4b3b-8baa-647f0a1dc148 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:54.304954 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9395cb83-7bf4-4b3b-8baa-647f0a1dc148 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:54.305777 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9395cb83-7bf4-4b3b-8baa-647f0a1dc148 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:54.306178 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-9395cb83-7bf4-4b3b-8baa-647f0a1dc148 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:54.383225 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-9395cb83-7bf4-4b3b-8baa-647f0a1dc148 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:54.390921 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-9395cb83-7bf4-4b3b-8baa-647f0a1dc148 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa" status: 200 len: 1302 microversion: 2.1 time: 0.100576 Nov 16 00:36:54.391440 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 533/1063] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:54 2021] GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa => generated 1302 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:55.410113 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-665f953c-49b5-4c40-a1a6-a3688a0c5b11 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:55.410824 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-665f953c-49b5-4c40-a1a6-a3688a0c5b11 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 4d07fda4-d89e-40fa-a740-a91145df3afa] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:55.417419 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-665f953c-49b5-4c40-a1a6-a3688a0c5b11 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:55.417867 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-665f953c-49b5-4c40-a1a6-a3688a0c5b11 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:55.418642 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-665f953c-49b5-4c40-a1a6-a3688a0c5b11 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:55.419096 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-665f953c-49b5-4c40-a1a6-a3688a0c5b11 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:55.432944 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-665f953c-49b5-4c40-a1a6-a3688a0c5b11 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] HTTP exception thrown: Instance 4d07fda4-d89e-40fa-a740-a91145df3afa could not be found. Nov 16 00:36:55.433590 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-665f953c-49b5-4c40-a1a6-a3688a0c5b11 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Returning 404 to user: Instance 4d07fda4-d89e-40fa-a740-a91145df3afa could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:36:55.434352 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-665f953c-49b5-4c40-a1a6-a3688a0c5b11 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa" status: 404 len: 111 microversion: 2.1 time: 0.029769 Nov 16 00:36:55.434889 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 531/1064] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:55 2021] GET /compute/v2.1/servers/4d07fda4-d89e-40fa-a740-a91145df3afa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:36:55.443528 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-613bb2e2-827a-4c05-a98e-69392bb96180 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:55.444036 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-613bb2e2-827a-4c05-a98e-69392bb96180 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 081f2420-eaa6-4d4c-a750-f4ca807d9d14] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:55.450067 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-613bb2e2-827a-4c05-a98e-69392bb96180 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:55.450502 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-613bb2e2-827a-4c05-a98e-69392bb96180 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:55.451290 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-613bb2e2-827a-4c05-a98e-69392bb96180 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:55.451714 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-613bb2e2-827a-4c05-a98e-69392bb96180 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:55.476523 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-613bb2e2-827a-4c05-a98e-69392bb96180 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 081f2420-eaa6-4d4c-a750-f4ca807d9d14] Going to try to terminate instance {{(pid=122543) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:36:55.547940 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-613bb2e2-827a-4c05-a98e-69392bb96180 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "DELETE /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14" status: 204 len: 0 microversion: 2.1 time: 0.108590 Nov 16 00:36:55.548517 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 534/1065] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:36:55 2021] DELETE /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 00:36:55.556510 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-75a5774c-18d4-4225-90cc-e6cfc129f48d tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:55.557119 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-75a5774c-18d4-4225-90cc-e6cfc129f48d tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 081f2420-eaa6-4d4c-a750-f4ca807d9d14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:55.562958 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-75a5774c-18d4-4225-90cc-e6cfc129f48d tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:55.563435 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-75a5774c-18d4-4225-90cc-e6cfc129f48d tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:55.564202 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-75a5774c-18d4-4225-90cc-e6cfc129f48d tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:55.564634 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-75a5774c-18d4-4225-90cc-e6cfc129f48d tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:55.689444 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-75a5774c-18d4-4225-90cc-e6cfc129f48d tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:55.696699 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-75a5774c-18d4-4225-90cc-e6cfc129f48d tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14" status: 200 len: 1513 microversion: 2.1 time: 0.143891 Nov 16 00:36:55.697251 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 532/1066] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:55 2021] GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14 => generated 1513 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:56.714032 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-98da74af-ec22-40c5-bb5f-74af1940c4bf tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:56.714724 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-98da74af-ec22-40c5-bb5f-74af1940c4bf tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 081f2420-eaa6-4d4c-a750-f4ca807d9d14] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:56.720559 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-98da74af-ec22-40c5-bb5f-74af1940c4bf tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:56.721031 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-98da74af-ec22-40c5-bb5f-74af1940c4bf tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:56.721786 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-98da74af-ec22-40c5-bb5f-74af1940c4bf tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:56.722706 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-98da74af-ec22-40c5-bb5f-74af1940c4bf tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:56.841852 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-98da74af-ec22-40c5-bb5f-74af1940c4bf tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:56.849595 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-98da74af-ec22-40c5-bb5f-74af1940c4bf tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14" status: 200 len: 1513 microversion: 2.1 time: 0.139570 Nov 16 00:36:56.850157 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 535/1067] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:56 2021] GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14 => generated 1513 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:57.866263 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d6962320-f775-4260-95c8-e1a9f2c82151 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:57.866860 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d6962320-f775-4260-95c8-e1a9f2c82151 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 081f2420-eaa6-4d4c-a750-f4ca807d9d14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:57.872729 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d6962320-f775-4260-95c8-e1a9f2c82151 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:57.873159 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d6962320-f775-4260-95c8-e1a9f2c82151 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:57.873908 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d6962320-f775-4260-95c8-e1a9f2c82151 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:57.874371 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d6962320-f775-4260-95c8-e1a9f2c82151 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:57.998896 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-d6962320-f775-4260-95c8-e1a9f2c82151 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:58.007074 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d6962320-f775-4260-95c8-e1a9f2c82151 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14" status: 200 len: 1513 microversion: 2.1 time: 0.144441 Nov 16 00:36:58.007633 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 533/1068] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:57 2021] GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14 => generated 1513 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:59.023864 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-d07ae391-322b-4234-af15-408364fc7363 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:36:59.024470 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d07ae391-322b-4234-af15-408364fc7363 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 081f2420-eaa6-4d4c-a750-f4ca807d9d14] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:36:59.031075 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d07ae391-322b-4234-af15-408364fc7363 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:59.031522 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d07ae391-322b-4234-af15-408364fc7363 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:59.032296 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d07ae391-322b-4234-af15-408364fc7363 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:36:59.032722 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d07ae391-322b-4234-af15-408364fc7363 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:36:59.166437 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-d07ae391-322b-4234-af15-408364fc7363 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:36:59.173998 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-d07ae391-322b-4234-af15-408364fc7363 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14" status: 200 len: 1513 microversion: 2.1 time: 0.153758 Nov 16 00:36:59.174588 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 536/1069] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:36:59 2021] GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:36:59.996870 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-e61f402e-a9c8-4871-aa48-d2a9372ea151 req-c637207d-5b85-4d19-ae32-c719329a7c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "081f2420-eaa6-4d4c-a750-f4ca807d9d14", "name": "network-vif-deleted", "tag": "d6680774-dc79-4ad5-a0f2-d8eb25c28626"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:36:59.998386 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:36:59.998386 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:37:00.006497 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-e61f402e-a9c8-4871-aa48-d2a9372ea151 req-c637207d-5b85-4d19-ae32-c719329a7c1e service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:00.006930 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-e61f402e-a9c8-4871-aa48-d2a9372ea151 req-c637207d-5b85-4d19-ae32-c719329a7c1e service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:00.018682 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-e61f402e-a9c8-4871-aa48-d2a9372ea151 req-c637207d-5b85-4d19-ae32-c719329a7c1e service nova] Creating event network-vif-deleted:d6680774-dc79-4ad5-a0f2-d8eb25c28626 for instance 081f2420-eaa6-4d4c-a750-f4ca807d9d14 on hv-cinder-81115 Nov 16 00:37:00.024384 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-e61f402e-a9c8-4871-aa48-d2a9372ea151 req-c637207d-5b85-4d19-ae32-c719329a7c1e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031632 Nov 16 00:37:00.024982 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 534/1070] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:36:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:37:00.191275 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-2b5b6102-0b68-4bdf-bd2c-88ee65c80f6f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:00.191937 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-2b5b6102-0b68-4bdf-bd2c-88ee65c80f6f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 081f2420-eaa6-4d4c-a750-f4ca807d9d14] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:00.197663 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2b5b6102-0b68-4bdf-bd2c-88ee65c80f6f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:00.198100 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2b5b6102-0b68-4bdf-bd2c-88ee65c80f6f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:00.198860 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2b5b6102-0b68-4bdf-bd2c-88ee65c80f6f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:00.199311 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2b5b6102-0b68-4bdf-bd2c-88ee65c80f6f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:00.229856 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2b5b6102-0b68-4bdf-bd2c-88ee65c80f6f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:00.230300 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2b5b6102-0b68-4bdf-bd2c-88ee65c80f6f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:00.230739 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.objects.instance [None req-2b5b6102-0b68-4bdf-bd2c-88ee65c80f6f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lazy-loading 'fault' on Instance uuid 081f2420-eaa6-4d4c-a750-f4ca807d9d14 {{(pid=122543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:37:00.271006 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2b5b6102-0b68-4bdf-bd2c-88ee65c80f6f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:00.278265 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-2b5b6102-0b68-4bdf-bd2c-88ee65c80f6f tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14" status: 200 len: 1307 microversion: 2.1 time: 0.090690 Nov 16 00:37:00.278821 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 537/1071] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:00 2021] GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14 => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:37:01.296553 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-519e6914-f481-42d6-904b-08c83beb5500 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:01.297258 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-519e6914-f481-42d6-904b-08c83beb5500 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 081f2420-eaa6-4d4c-a750-f4ca807d9d14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:01.304118 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-519e6914-f481-42d6-904b-08c83beb5500 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:01.304562 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-519e6914-f481-42d6-904b-08c83beb5500 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:01.305710 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-519e6914-f481-42d6-904b-08c83beb5500 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:01.305986 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-519e6914-f481-42d6-904b-08c83beb5500 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:01.321267 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-519e6914-f481-42d6-904b-08c83beb5500 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] HTTP exception thrown: Instance 081f2420-eaa6-4d4c-a750-f4ca807d9d14 could not be found. Nov 16 00:37:01.321854 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-519e6914-f481-42d6-904b-08c83beb5500 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Returning 404 to user: Instance 081f2420-eaa6-4d4c-a750-f4ca807d9d14 could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:37:01.322666 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-519e6914-f481-42d6-904b-08c83beb5500 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14" status: 404 len: 111 microversion: 2.1 time: 0.030210 Nov 16 00:37:01.323233 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 535/1072] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:01 2021] GET /compute/v2.1/servers/081f2420-eaa6-4d4c-a750-f4ca807d9d14 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:37:02.458801 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-976bcae6-34e1-456b-81c9-cf42acfab5c1 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:02.459308 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-976bcae6-34e1-456b-81c9-cf42acfab5c1 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:02.464985 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-976bcae6-34e1-456b-81c9-cf42acfab5c1 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:02.465430 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-976bcae6-34e1-456b-81c9-cf42acfab5c1 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:02.466198 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-976bcae6-34e1-456b-81c9-cf42acfab5c1 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:02.466627 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-976bcae6-34e1-456b-81c9-cf42acfab5c1 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:02.491386 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-976bcae6-34e1-456b-81c9-cf42acfab5c1 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Going to try to terminate instance {{(pid=122543) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:37:02.562748 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-976bcae6-34e1-456b-81c9-cf42acfab5c1 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "DELETE /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 204 len: 0 microversion: 2.1 time: 0.107435 Nov 16 00:37:02.563397 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 538/1073] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:37:02 2021] DELETE /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 00:37:02.572086 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-67a88823-9623-4228-889f-c00b0f832424 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:02.572682 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-67a88823-9623-4228-889f-c00b0f832424 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:02.578422 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-67a88823-9623-4228-889f-c00b0f832424 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:02.578876 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-67a88823-9623-4228-889f-c00b0f832424 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:02.579664 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-67a88823-9623-4228-889f-c00b0f832424 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:02.580089 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-67a88823-9623-4228-889f-c00b0f832424 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:02.701345 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-67a88823-9623-4228-889f-c00b0f832424 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:02.708666 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-67a88823-9623-4228-889f-c00b0f832424 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1515 microversion: 2.1 time: 0.140218 Nov 16 00:37:02.709215 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 536/1074] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:02 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1515 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:37:03.726133 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-e764b417-33d9-44cd-966f-dc74e34fda20 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:03.726841 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-e764b417-33d9-44cd-966f-dc74e34fda20 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:03.732566 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e764b417-33d9-44cd-966f-dc74e34fda20 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:03.733014 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e764b417-33d9-44cd-966f-dc74e34fda20 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:03.733778 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e764b417-33d9-44cd-966f-dc74e34fda20 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:03.734206 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e764b417-33d9-44cd-966f-dc74e34fda20 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:03.854640 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e764b417-33d9-44cd-966f-dc74e34fda20 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:03.861721 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-e764b417-33d9-44cd-966f-dc74e34fda20 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1515 microversion: 2.1 time: 0.139743 Nov 16 00:37:03.862289 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 539/1075] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:03 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1515 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:37:04.566496 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-ef4b657e-6168-4e8f-82be-105239d56aba req-d7b72741-ab72-496a-8006-59f047e638ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7f9627-db3b-428d-819b-5c5c59084942", "name": "network-vif-deleted", "tag": "13925c20-f053-442a-8124-fd021f837b58"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:37:04.568064 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:37:04.568064 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:37:04.575075 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-ef4b657e-6168-4e8f-82be-105239d56aba req-d7b72741-ab72-496a-8006-59f047e638ee service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:04.575509 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-ef4b657e-6168-4e8f-82be-105239d56aba req-d7b72741-ab72-496a-8006-59f047e638ee service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:04.586902 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-ef4b657e-6168-4e8f-82be-105239d56aba req-d7b72741-ab72-496a-8006-59f047e638ee service nova] Creating event network-vif-deleted:13925c20-f053-442a-8124-fd021f837b58 for instance 2f7f9627-db3b-428d-819b-5c5c59084942 on hv-cinder-81115 Nov 16 00:37:04.592354 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-ef4b657e-6168-4e8f-82be-105239d56aba req-d7b72741-ab72-496a-8006-59f047e638ee service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029940 Nov 16 00:37:04.597774 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 537/1076] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:37:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:37:04.880669 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-2cfc7595-1deb-48b9-a8ae-3ad9cd772e41 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:04.881275 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-2cfc7595-1deb-48b9-a8ae-3ad9cd772e41 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:04.886999 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2cfc7595-1deb-48b9-a8ae-3ad9cd772e41 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:04.887470 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2cfc7595-1deb-48b9-a8ae-3ad9cd772e41 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:04.888285 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2cfc7595-1deb-48b9-a8ae-3ad9cd772e41 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:04.888718 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2cfc7595-1deb-48b9-a8ae-3ad9cd772e41 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:04.921253 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2cfc7595-1deb-48b9-a8ae-3ad9cd772e41 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:04.921707 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2cfc7595-1deb-48b9-a8ae-3ad9cd772e41 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:04.922158 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.objects.instance [None req-2cfc7595-1deb-48b9-a8ae-3ad9cd772e41 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lazy-loading 'fault' on Instance uuid 2f7f9627-db3b-428d-819b-5c5c59084942 {{(pid=122543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:37:04.963280 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2cfc7595-1deb-48b9-a8ae-3ad9cd772e41 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facd3c2e165f495c86342ba380ca5d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b08090244b44b94bdedacad6778dec0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:04.971283 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-2cfc7595-1deb-48b9-a8ae-3ad9cd772e41 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 200 len: 1308 microversion: 2.1 time: 0.094515 Nov 16 00:37:04.972388 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 540/1077] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:04 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:37:05.990366 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-14c91309-2457-4d3b-9671-39ed03f014e3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:05.991087 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-14c91309-2457-4d3b-9671-39ed03f014e3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] [instance: 2f7f9627-db3b-428d-819b-5c5c59084942] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:05.997968 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-14c91309-2457-4d3b-9671-39ed03f014e3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:05.998504 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-14c91309-2457-4d3b-9671-39ed03f014e3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:05.999390 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-14c91309-2457-4d3b-9671-39ed03f014e3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:05.999847 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-14c91309-2457-4d3b-9671-39ed03f014e3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:06.013495 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-14c91309-2457-4d3b-9671-39ed03f014e3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] HTTP exception thrown: Instance 2f7f9627-db3b-428d-819b-5c5c59084942 could not be found. Nov 16 00:37:06.014053 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-14c91309-2457-4d3b-9671-39ed03f014e3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] Returning 404 to user: Instance 2f7f9627-db3b-428d-819b-5c5c59084942 could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:37:06.014838 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-14c91309-2457-4d3b-9671-39ed03f014e3 tempest-AttachVolumeNegativeTest-1901580606 tempest-AttachVolumeNegativeTest-1901580606-project] 10.222.0.31 "GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942" status: 404 len: 111 microversion: 2.1 time: 0.029257 Nov 16 00:37:06.015627 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 538/1078] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:05 2021] GET /compute/v2.1/servers/2f7f9627-db3b-428d-819b-5c5c59084942 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:37:09.060198 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-637e50e0-6d5c-4e04-823a-c92824eb6627 tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] Calling method '.version_select at 0x7f2f2953fca0>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:09.117749 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-637e50e0-6d5c-4e04-823a-c92824eb6627 tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/31c178b8-4b16-45bf-a170-f5b4459fd1d9" status: 200 len: 350 microversion: 2.1 time: 0.060999 Nov 16 00:37:09.118500 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 541/1079] 10.222.0.31 () {58 vars in 1244 bytes} [Tue Nov 16 00:37:09 2021] GET /compute/v2.1/os-volumes/31c178b8-4b16-45bf-a170-f5b4459fd1d9 => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:37:10.434542 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-5d8ba252-8cdf-40f7-97a2-974b9425c44a tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] Calling method '.version_select at 0x7f2f294d8550>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:10.486226 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-5d8ba252-8cdf-40f7-97a2-974b9425c44a tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/a900aa1c-d772-4bf5-be7d-3c487b253295" status: 200 len: 350 microversion: 2.1 time: 0.055273 Nov 16 00:37:10.486783 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 539/1080] 10.222.0.31 () {58 vars in 1244 bytes} [Tue Nov 16 00:37:10 2021] GET /compute/v2.1/os-volumes/a900aa1c-d772-4bf5-be7d-3c487b253295 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:37:11.803522 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-2dc2c635-9f0a-4c2b-ae54-d0e92b4846b4 tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] Calling method '.version_select at 0x7f2f2e4011f0>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:11.853408 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-2dc2c635-9f0a-4c2b-ae54-d0e92b4846b4 tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/5d40ac2c-43bf-448d-8556-6d521a92459e" status: 200 len: 350 microversion: 2.1 time: 0.053943 Nov 16 00:37:11.853965 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 542/1081] 10.222.0.31 () {58 vars in 1244 bytes} [Tue Nov 16 00:37:11 2021] GET /compute/v2.1/os-volumes/5d40ac2c-43bf-448d-8556-6d521a92459e => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:37:11.865165 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-2592df9d-4fca-4982-9de0-b86329967fad tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] Calling method '.version_select at 0x7f2f29456b80>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:11.946591 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-2592df9d-4fca-4982-9de0-b86329967fad tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] 10.222.0.31 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.085392 Nov 16 00:37:11.947187 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 540/1082] 10.222.0.31 () {58 vars in 1133 bytes} [Tue Nov 16 00:37:11 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:37:11.959269 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-508feb50-d8a3-45db-8e77-34cd29ebb366 tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] Calling method '.version_select at 0x7f2f2e3fe790>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:12.049495 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-508feb50-d8a3-45db-8e77-34cd29ebb366 tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] 10.222.0.31 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.093959 Nov 16 00:37:12.050729 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 543/1083] 10.222.0.31 () {58 vars in 1148 bytes} [Tue Nov 16 00:37:11 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:37:12.062247 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-6ffc7014-a185-4564-ab68-5a76d587715c tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] Calling method '.version_select at 0x7f2f295b8280>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:12.142709 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-6ffc7014-a185-4564-ab68-5a76d587715c tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] 10.222.0.31 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.083855 Nov 16 00:37:12.143296 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 541/1084] 10.222.0.31 () {58 vars in 1133 bytes} [Tue Nov 16 00:37:12 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:37:12.154350 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-63492bc1-c292-4914-a5bf-9448c0b2cda4 tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] Calling method '.version_select at 0x7f2f2e401550>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:12.233927 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-63492bc1-c292-4914-a5bf-9448c0b2cda4 tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] 10.222.0.31 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083068 Nov 16 00:37:12.234530 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 544/1085] 10.222.0.31 () {58 vars in 1166 bytes} [Tue Nov 16 00:37:12 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:37:12.246754 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-9ea7436b-6750-4bdb-b6b2-1122a12e32e2 tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] Calling method '.version_select at 0x7f2f2974d8b0>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:12.328654 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-9ea7436b-6750-4bdb-b6b2-1122a12e32e2 tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.085311 Nov 16 00:37:12.329256 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 542/1086] 10.222.0.31 () {58 vars in 1169 bytes} [Tue Nov 16 00:37:12 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:37:12.341250 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c76a6263-df7b-4088-8a1d-0ee23046d60c tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] Calling method '.version_select at 0x7f2f2e3feca0>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:12.422882 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c76a6263-df7b-4088-8a1d-0ee23046d60c tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.085069 Nov 16 00:37:12.423495 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 545/1087] 10.222.0.31 () {58 vars in 1154 bytes} [Tue Nov 16 00:37:12 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:37:12.435000 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0306d33e-bf00-495b-9bcd-3b0423eea605 tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] Calling method '.version_select at 0x7f2f293c6430>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:12.513151 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0306d33e-bf00-495b-9bcd-3b0423eea605 tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.081610 Nov 16 00:37:12.513707 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 543/1088] 10.222.0.31 () {58 vars in 1187 bytes} [Tue Nov 16 00:37:12 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:37:12.535526 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-9e7ea23f-4ebc-4a27-b3e6-1846cf2670e0 tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] Calling method '.version_select at 0x7f2f29503040>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:12.615364 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-9e7ea23f-4ebc-4a27-b3e6-1846cf2670e0 tempest-VolumesTestJSON-125600472 tempest-VolumesTestJSON-125600472-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.086587 Nov 16 00:37:12.616116 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 546/1089] 10.222.0.31 () {58 vars in 1154 bytes} [Tue Nov 16 00:37:12 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:37:23.646106 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 00:37:23.646600 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: Tue Nov 16 00:37:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 00:37:47.403898 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-ceaf28fd-48e6-493a-8ac4-648b8a1db6cb tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:47.405076 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-ceaf28fd-48e6-493a-8ac4-648b8a1db6cb tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:47.413204 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ceaf28fd-48e6-493a-8ac4-648b8a1db6cb tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:47.414049 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ceaf28fd-48e6-493a-8ac4-648b8a1db6cb tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:47.415028 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ceaf28fd-48e6-493a-8ac4-648b8a1db6cb tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:47.415702 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ceaf28fd-48e6-493a-8ac4-648b8a1db6cb tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:47.417142 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-1431f66b-3b5b-4ce6-b31b-c49076edb74c req-bb9b47e2-dfa6-4652-a7be-a90f03358056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de441742-51f2-454f-902d-c9da73b74a14", "tag": "dd1e79b1-adea-4951-9c03-a4819deabd55"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:37:47.418819 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:37:47.418819 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:37:47.432065 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-1431f66b-3b5b-4ce6-b31b-c49076edb74c req-bb9b47e2-dfa6-4652-a7be-a90f03358056 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:47.432501 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-1431f66b-3b5b-4ce6-b31b-c49076edb74c req-bb9b47e2-dfa6-4652-a7be-a90f03358056 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:47.446594 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-1431f66b-3b5b-4ce6-b31b-c49076edb74c req-bb9b47e2-dfa6-4652-a7be-a90f03358056 service nova] Creating event network-changed:dd1e79b1-adea-4951-9c03-a4819deabd55 for instance de441742-51f2-454f-902d-c9da73b74a14 on hv-cinder-81115 Nov 16 00:37:47.451746 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-1431f66b-3b5b-4ce6-b31b-c49076edb74c req-bb9b47e2-dfa6-4652-a7be-a90f03358056 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039377 Nov 16 00:37:47.456953 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 547/1090] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:37:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:37:47.462959 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-ceaf28fd-48e6-493a-8ac4-648b8a1db6cb tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Going to try to terminate instance {{(pid=122544) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:37:47.590022 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-ceaf28fd-48e6-493a-8ac4-648b8a1db6cb tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "DELETE /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 204 len: 0 microversion: 2.1 time: 0.190146 Nov 16 00:37:47.593319 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 544/1091] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:37:47 2021] DELETE /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 00:37:47.603875 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-e658edc1-1551-453d-9b93-96e49ca5e926 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:47.604644 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-e658edc1-1551-453d-9b93-96e49ca5e926 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:47.616480 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e658edc1-1551-453d-9b93-96e49ca5e926 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:47.616991 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e658edc1-1551-453d-9b93-96e49ca5e926 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:47.618710 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e658edc1-1551-453d-9b93-96e49ca5e926 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:47.620423 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e658edc1-1551-453d-9b93-96e49ca5e926 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:47.911417 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e658edc1-1551-453d-9b93-96e49ca5e926 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:47.923202 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-e658edc1-1551-453d-9b93-96e49ca5e926 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1579 microversion: 2.1 time: 0.324384 Nov 16 00:37:47.924697 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 548/1092] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:47 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1579 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:37:48.942521 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-1a608a49-955d-4f3c-a04e-93fde2b53ef0 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:48.943239 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-1a608a49-955d-4f3c-a04e-93fde2b53ef0 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:48.949789 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1a608a49-955d-4f3c-a04e-93fde2b53ef0 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:48.950667 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1a608a49-955d-4f3c-a04e-93fde2b53ef0 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:48.951814 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1a608a49-955d-4f3c-a04e-93fde2b53ef0 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:48.952393 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-1a608a49-955d-4f3c-a04e-93fde2b53ef0 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:49.126069 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-1a608a49-955d-4f3c-a04e-93fde2b53ef0 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:49.133909 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-1a608a49-955d-4f3c-a04e-93fde2b53ef0 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1461 microversion: 2.1 time: 0.195850 Nov 16 00:37:49.134976 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 545/1093] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:48 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1461 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:37:49.901451 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-811f101f-865b-4bdf-86bd-1614fb740674 req-e5052384-03ee-4278-b2b7-a29f54ff421d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de441742-51f2-454f-902d-c9da73b74a14", "name": "network-vif-deleted", "tag": "dd1e79b1-adea-4951-9c03-a4819deabd55"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:37:49.903590 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:37:49.903590 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:37:49.911223 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-811f101f-865b-4bdf-86bd-1614fb740674 req-e5052384-03ee-4278-b2b7-a29f54ff421d service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:49.911772 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-811f101f-865b-4bdf-86bd-1614fb740674 req-e5052384-03ee-4278-b2b7-a29f54ff421d service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:49.922811 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-811f101f-865b-4bdf-86bd-1614fb740674 req-e5052384-03ee-4278-b2b7-a29f54ff421d service nova] Creating event network-vif-deleted:dd1e79b1-adea-4951-9c03-a4819deabd55 for instance de441742-51f2-454f-902d-c9da73b74a14 on hv-cinder-81115 Nov 16 00:37:49.928089 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-811f101f-865b-4bdf-86bd-1614fb740674 req-e5052384-03ee-4278-b2b7-a29f54ff421d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030778 Nov 16 00:37:49.929263 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 549/1094] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:37:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:37:50.152054 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-7d6fdacd-c64f-4c8d-a5ea-ee4a005b7d4f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:50.152669 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-7d6fdacd-c64f-4c8d-a5ea-ee4a005b7d4f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:50.158738 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7d6fdacd-c64f-4c8d-a5ea-ee4a005b7d4f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:50.159219 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7d6fdacd-c64f-4c8d-a5ea-ee4a005b7d4f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:50.160009 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7d6fdacd-c64f-4c8d-a5ea-ee4a005b7d4f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:50.160429 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7d6fdacd-c64f-4c8d-a5ea-ee4a005b7d4f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:50.229990 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-7d6fdacd-c64f-4c8d-a5ea-ee4a005b7d4f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:50.240521 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-7d6fdacd-c64f-4c8d-a5ea-ee4a005b7d4f tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 200 len: 1226 microversion: 2.1 time: 0.092354 Nov 16 00:37:50.241186 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 546/1095] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:50 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:37:50.490771 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-d825143e-b9a3-4221-837a-0a9a0248b560 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1718038323", "imageRef": "bb47ca05-3b48-4f1c-bc96-e0c5c672caba", "flavorRef": "452", "networks": [{"uuid": "d472da9d-80d9-479d-822c-b6e8632df992"}]}} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:37:50.546709 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.network.neutron [None req-d825143e-b9a3-4221-837a-0a9a0248b560 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] validate_networks() for [('d472da9d-80d9-479d-822c-b6e8632df992', None, None, None, None, None)] {{(pid=122543) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:37:50.914571 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-d825143e-b9a3-4221-837a-0a9a0248b560 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Flavor limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:37:50.915198 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-d825143e-b9a3-4221-837a-0a9a0248b560 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Image limits 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:37:50.915506 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-d825143e-b9a3-4221-837a-0a9a0248b560 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Flavor pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:37:50.915936 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-d825143e-b9a3-4221-837a-0a9a0248b560 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Image pref 0:0:0 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:37:50.916333 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.virt.hardware [None req-d825143e-b9a3-4221-837a-0a9a0248b560 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:37:50.925737 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d825143e-b9a3-4221-837a-0a9a0248b560 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:50.926184 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d825143e-b9a3-4221-837a-0a9a0248b560 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:50.926989 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d825143e-b9a3-4221-837a-0a9a0248b560 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:50.927449 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d825143e-b9a3-4221-837a-0a9a0248b560 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:50.943459 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-d825143e-b9a3-4221-837a-0a9a0248b560 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Getting quotas for project 4f9b691378844135bec95fb0c25829cc. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:37:50.947341 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.quota [None req-d825143e-b9a3-4221-837a-0a9a0248b560 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Getting quotas for user 53025a2dea324aab903a49328416eead and project 4f9b691378844135bec95fb0c25829cc. Resources: {'instances', 'cores', 'ram'} {{(pid=122543) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:37:50.958416 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d825143e-b9a3-4221-837a-0a9a0248b560 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Going to run 1 instances... {{(pid=122543) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:37:50.960890 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d825143e-b9a3-4221-837a-0a9a0248b560 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: 0c9d3cd5-3621-41d7-9c4b-3c60b1b65094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb47ca05-3b48-4f1c-bc96-e0c5c672caba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:37:51.010824 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-d825143e-b9a3-4221-837a-0a9a0248b560 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525287 Nov 16 00:37:51.011567 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 550/1096] 10.222.0.31 () {60 vars in 1146 bytes} [Tue Nov 16 00:37:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 00:37:51.022181 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-58920042-0136-445e-bc03-8ce28aff2973 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:51.022790 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-58920042-0136-445e-bc03-8ce28aff2973 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: 0c9d3cd5-3621-41d7-9c4b-3c60b1b65094] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:51.077920 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-58920042-0136-445e-bc03-8ce28aff2973 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:51.085301 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-58920042-0136-445e-bc03-8ce28aff2973 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094" status: 200 len: 1214 microversion: 2.1 time: 0.067060 Nov 16 00:37:51.085834 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 547/1097] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:51 2021] GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:37:51.258278 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-696c8ee2-0492-4a7c-be0d-ea879bac7eb4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:51.259132 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-696c8ee2-0492-4a7c-be0d-ea879bac7eb4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: de441742-51f2-454f-902d-c9da73b74a14] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:51.266281 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-696c8ee2-0492-4a7c-be0d-ea879bac7eb4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:51.266806 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-696c8ee2-0492-4a7c-be0d-ea879bac7eb4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:51.268340 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-696c8ee2-0492-4a7c-be0d-ea879bac7eb4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:51.268937 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-696c8ee2-0492-4a7c-be0d-ea879bac7eb4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:51.286325 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-696c8ee2-0492-4a7c-be0d-ea879bac7eb4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] HTTP exception thrown: Instance de441742-51f2-454f-902d-c9da73b74a14 could not be found. Nov 16 00:37:51.286916 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-696c8ee2-0492-4a7c-be0d-ea879bac7eb4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Returning 404 to user: Instance de441742-51f2-454f-902d-c9da73b74a14 could not be found. {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:37:51.287780 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-696c8ee2-0492-4a7c-be0d-ea879bac7eb4 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14" status: 404 len: 111 microversion: 2.1 time: 0.033285 Nov 16 00:37:51.291451 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 551/1098] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:51 2021] GET /compute/v2.1/servers/de441742-51f2-454f-902d-c9da73b74a14 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:37:52.103479 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-614e3133-f39e-4637-a746-0391e9497496 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:52.104298 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-614e3133-f39e-4637-a746-0391e9497496 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: 0c9d3cd5-3621-41d7-9c4b-3c60b1b65094] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:52.110398 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-614e3133-f39e-4637-a746-0391e9497496 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:52.111277 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-614e3133-f39e-4637-a746-0391e9497496 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:52.112214 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-614e3133-f39e-4637-a746-0391e9497496 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:52.112713 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-614e3133-f39e-4637-a746-0391e9497496 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:52.183125 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-614e3133-f39e-4637-a746-0391e9497496 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:52.191014 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-614e3133-f39e-4637-a746-0391e9497496 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094" status: 200 len: 1272 microversion: 2.1 time: 0.092017 Nov 16 00:37:52.192203 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 548/1099] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:52 2021] GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094 => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:37:53.211157 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-77fe6765-a90f-4e40-88d7-685b31547b7e tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:53.211809 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-77fe6765-a90f-4e40-88d7-685b31547b7e tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: 0c9d3cd5-3621-41d7-9c4b-3c60b1b65094] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:53.218724 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-77fe6765-a90f-4e40-88d7-685b31547b7e tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:53.219372 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-77fe6765-a90f-4e40-88d7-685b31547b7e tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:53.220495 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-77fe6765-a90f-4e40-88d7-685b31547b7e tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:53.220952 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-77fe6765-a90f-4e40-88d7-685b31547b7e tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:53.231422 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-b4468024-21bb-43d1-a441-fc9f67812e42 req-308b2fc8-26f9-4c9b-b12d-f4badf480ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c9d3cd5-3621-41d7-9c4b-3c60b1b65094", "tag": "2c1d65ba-8817-4587-9198-7b1adf4338b0"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:37:53.233372 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:37:53.233372 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:37:53.242697 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-b4468024-21bb-43d1-a441-fc9f67812e42 req-308b2fc8-26f9-4c9b-b12d-f4badf480ff6 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:53.243266 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-b4468024-21bb-43d1-a441-fc9f67812e42 req-308b2fc8-26f9-4c9b-b12d-f4badf480ff6 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:53.257783 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-b4468024-21bb-43d1-a441-fc9f67812e42 req-308b2fc8-26f9-4c9b-b12d-f4badf480ff6 service nova] Creating event network-changed:2c1d65ba-8817-4587-9198-7b1adf4338b0 for instance 0c9d3cd5-3621-41d7-9c4b-3c60b1b65094 on hv-cinder-81115 Nov 16 00:37:53.262460 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-b4468024-21bb-43d1-a441-fc9f67812e42 req-308b2fc8-26f9-4c9b-b12d-f4badf480ff6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037122 Nov 16 00:37:53.263505 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 549/1100] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:37:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:37:53.746858 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-77fe6765-a90f-4e40-88d7-685b31547b7e tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:53.755841 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-77fe6765-a90f-4e40-88d7-685b31547b7e tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094" status: 200 len: 1314 microversion: 2.1 time: 0.549825 Nov 16 00:37:53.757088 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 552/1101] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:53 2021] GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:37:54.683103 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-6883e41c-db38-4e17-8d49-60bf433c1681 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:54.683687 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-6883e41c-db38-4e17-8d49-60bf433c1681 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:54.685753 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-8d4c8a90-6508-4b19-811b-75e2ab11e73e req-bf75190e-800f-411e-99b9-6bfd310b7a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba21a21-76fa-4a68-b4ec-79454bdc3b4e", "tag": "cbec7d92-b961-49b3-8246-e6dad3a5521d"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:37:54.687507 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:37:54.687507 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:37:54.689845 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6883e41c-db38-4e17-8d49-60bf433c1681 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:54.690643 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6883e41c-db38-4e17-8d49-60bf433c1681 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:54.691459 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6883e41c-db38-4e17-8d49-60bf433c1681 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:54.691882 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6883e41c-db38-4e17-8d49-60bf433c1681 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:54.699603 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-8d4c8a90-6508-4b19-811b-75e2ab11e73e req-bf75190e-800f-411e-99b9-6bfd310b7a3d service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:54.700132 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-8d4c8a90-6508-4b19-811b-75e2ab11e73e req-bf75190e-800f-411e-99b9-6bfd310b7a3d service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:54.713261 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-8d4c8a90-6508-4b19-811b-75e2ab11e73e req-bf75190e-800f-411e-99b9-6bfd310b7a3d service nova] Creating event network-changed:cbec7d92-b961-49b3-8246-e6dad3a5521d for instance 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e on hv-cinder-81115 Nov 16 00:37:54.719918 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-8d4c8a90-6508-4b19-811b-75e2ab11e73e req-bf75190e-800f-411e-99b9-6bfd310b7a3d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037750 Nov 16 00:37:54.721028 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-6883e41c-db38-4e17-8d49-60bf433c1681 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Going to try to terminate instance {{(pid=122544) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:37:54.721848 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 553/1102] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:37:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:37:54.774772 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-6964fa3d-7fdb-40a2-a859-637aa8703a9a tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:54.775762 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-6964fa3d-7fdb-40a2-a859-637aa8703a9a tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: 0c9d3cd5-3621-41d7-9c4b-3c60b1b65094] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:54.789643 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6964fa3d-7fdb-40a2-a859-637aa8703a9a tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:54.792166 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6964fa3d-7fdb-40a2-a859-637aa8703a9a tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:54.793043 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6964fa3d-7fdb-40a2-a859-637aa8703a9a tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:54.795251 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-6964fa3d-7fdb-40a2-a859-637aa8703a9a tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:54.861067 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-6883e41c-db38-4e17-8d49-60bf433c1681 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 204 len: 0 microversion: 2.1 time: 0.181610 Nov 16 00:37:54.861646 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 550/1103] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:37:54 2021] DELETE /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 00:37:54.870816 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-45ea3735-62b1-4799-9c78-3e1587c37083 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:54.871658 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-45ea3735-62b1-4799-9c78-3e1587c37083 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:54.878511 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-45ea3735-62b1-4799-9c78-3e1587c37083 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:54.879178 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-45ea3735-62b1-4799-9c78-3e1587c37083 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:54.880033 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-45ea3735-62b1-4799-9c78-3e1587c37083 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:54.880608 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-45ea3735-62b1-4799-9c78-3e1587c37083 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:55.040060 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-6964fa3d-7fdb-40a2-a859-637aa8703a9a tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:55.051423 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-45ea3735-62b1-4799-9c78-3e1587c37083 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:55.060139 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-45ea3735-62b1-4799-9c78-3e1587c37083 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1579 microversion: 2.1 time: 0.193781 Nov 16 00:37:55.061980 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-6964fa3d-7fdb-40a2-a859-637aa8703a9a tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094" status: 200 len: 1314 microversion: 2.1 time: 0.291405 Nov 16 00:37:55.063777 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 554/1104] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:54 2021] GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:37:55.064198 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 551/1105] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:54 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1579 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:37:56.079260 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-a0c5de6b-3597-4e2c-a55f-781f0b1b9dbd tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:56.080369 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-fb0837c4-d2f8-4e75-905a-57fade66d742 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:56.080737 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-a0c5de6b-3597-4e2c-a55f-781f0b1b9dbd tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: 0c9d3cd5-3621-41d7-9c4b-3c60b1b65094] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:56.080975 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-fb0837c4-d2f8-4e75-905a-57fade66d742 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:56.086521 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a0c5de6b-3597-4e2c-a55f-781f0b1b9dbd tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:56.086812 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-fb0837c4-d2f8-4e75-905a-57fade66d742 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:56.086961 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a0c5de6b-3597-4e2c-a55f-781f0b1b9dbd tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:56.087334 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-fb0837c4-d2f8-4e75-905a-57fade66d742 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:56.087784 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a0c5de6b-3597-4e2c-a55f-781f0b1b9dbd tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:56.088137 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-fb0837c4-d2f8-4e75-905a-57fade66d742 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:56.088247 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a0c5de6b-3597-4e2c-a55f-781f0b1b9dbd tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:56.088571 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-fb0837c4-d2f8-4e75-905a-57fade66d742 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:56.209865 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-a0c5de6b-3597-4e2c-a55f-781f0b1b9dbd tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:56.212882 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-fb0837c4-d2f8-4e75-905a-57fade66d742 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:56.217078 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-a0c5de6b-3597-4e2c-a55f-781f0b1b9dbd tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094" status: 200 len: 1314 microversion: 2.1 time: 0.141427 Nov 16 00:37:56.218116 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 555/1106] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:56 2021] GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:37:56.220103 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-fb0837c4-d2f8-4e75-905a-57fade66d742 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1461 microversion: 2.1 time: 0.144023 Nov 16 00:37:56.220948 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 552/1107] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:56 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1461 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:37:56.821371 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-7d067483-f48a-4085-924a-24fcd7b900fe req-cb415c3a-67b3-45fc-bc44-7a5b702ed463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba21a21-76fa-4a68-b4ec-79454bdc3b4e", "name": "network-vif-deleted", "tag": "cbec7d92-b961-49b3-8246-e6dad3a5521d"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:37:56.822861 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:37:56.822861 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:37:56.825851 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-6348d525-1d24-4c9e-b8d7-544cbab24d2a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:37:56.826377 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-6348d525-1d24-4c9e-b8d7-544cbab24d2a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:56.830300 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-7d067483-f48a-4085-924a-24fcd7b900fe req-cb415c3a-67b3-45fc-bc44-7a5b702ed463 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:56.830822 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-7d067483-f48a-4085-924a-24fcd7b900fe req-cb415c3a-67b3-45fc-bc44-7a5b702ed463 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:56.832651 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6348d525-1d24-4c9e-b8d7-544cbab24d2a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:56.833161 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6348d525-1d24-4c9e-b8d7-544cbab24d2a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:56.834026 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6348d525-1d24-4c9e-b8d7-544cbab24d2a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:56.834448 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-6348d525-1d24-4c9e-b8d7-544cbab24d2a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:56.842288 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-7d067483-f48a-4085-924a-24fcd7b900fe req-cb415c3a-67b3-45fc-bc44-7a5b702ed463 service nova] Creating event network-vif-deleted:cbec7d92-b961-49b3-8246-e6dad3a5521d for instance 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e on hv-cinder-81115 Nov 16 00:37:56.847780 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-7d067483-f48a-4085-924a-24fcd7b900fe req-cb415c3a-67b3-45fc-bc44-7a5b702ed463 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031199 Nov 16 00:37:56.848445 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 556/1108] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:37:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:37:56.859428 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.objects.instance [None req-6348d525-1d24-4c9e-b8d7-544cbab24d2a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lazy-loading 'flavor' on Instance uuid 4d2b3498-9dc0-415d-8e78-dee875d29a7f {{(pid=122544) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:37:56.934262 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-6348d525-1d24-4c9e-b8d7-544cbab24d2a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "POST /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f/action" status: 202 len: 0 microversion: 2.1 time: 0.112003 Nov 16 00:37:56.934829 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 553/1109] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:37:56 2021] POST /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 16 00:37:56.944465 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-83d5e9fa-1956-41a7-a201-cce7a2e4039f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:56.945161 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-83d5e9fa-1956-41a7-a201-cce7a2e4039f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:56.951807 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-83d5e9fa-1956-41a7-a201-cce7a2e4039f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:56.952265 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-83d5e9fa-1956-41a7-a201-cce7a2e4039f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:56.953065 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-83d5e9fa-1956-41a7-a201-cce7a2e4039f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:56.953597 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-83d5e9fa-1956-41a7-a201-cce7a2e4039f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:57.078123 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-83d5e9fa-1956-41a7-a201-cce7a2e4039f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:57.086862 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-83d5e9fa-1956-41a7-a201-cce7a2e4039f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1568 microversion: 2.1 time: 0.146905 Nov 16 00:37:57.087567 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 557/1110] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:56 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:37:57.234507 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3c3f3463-812d-4911-8eca-3ca2c9e4e922 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:57.235400 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3c3f3463-812d-4911-8eca-3ca2c9e4e922 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: 0c9d3cd5-3621-41d7-9c4b-3c60b1b65094] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:57.240821 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-abb25a9a-a53a-4699-8ed0-aa09dcaa7017 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:57.241621 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-abb25a9a-a53a-4699-8ed0-aa09dcaa7017 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:57.242600 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3c3f3463-812d-4911-8eca-3ca2c9e4e922 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:57.243068 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3c3f3463-812d-4911-8eca-3ca2c9e4e922 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:57.243883 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3c3f3463-812d-4911-8eca-3ca2c9e4e922 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:57.244313 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3c3f3463-812d-4911-8eca-3ca2c9e4e922 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:57.247803 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-abb25a9a-a53a-4699-8ed0-aa09dcaa7017 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:57.248493 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-abb25a9a-a53a-4699-8ed0-aa09dcaa7017 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:57.249373 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-abb25a9a-a53a-4699-8ed0-aa09dcaa7017 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:57.250006 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-abb25a9a-a53a-4699-8ed0-aa09dcaa7017 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:57.282990 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-abb25a9a-a53a-4699-8ed0-aa09dcaa7017 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:57.283470 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-abb25a9a-a53a-4699-8ed0-aa09dcaa7017 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:57.283918 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.objects.instance [None req-abb25a9a-a53a-4699-8ed0-aa09dcaa7017 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lazy-loading 'fault' on Instance uuid 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e {{(pid=122543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:37:57.328184 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-abb25a9a-a53a-4699-8ed0-aa09dcaa7017 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa70de1eca24c8da180736ff9ebc553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cce0078a151f47738c5863929c403dc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:57.336329 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-abb25a9a-a53a-4699-8ed0-aa09dcaa7017 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 200 len: 1231 microversion: 2.1 time: 0.101650 Nov 16 00:37:57.346197 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 558/1111] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:57 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 1231 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:37:57.386283 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3c3f3463-812d-4911-8eca-3ca2c9e4e922 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:57.395071 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-3c3f3463-812d-4911-8eca-3ca2c9e4e922 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094" status: 200 len: 1314 microversion: 2.1 time: 0.164916 Nov 16 00:37:57.396280 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 554/1112] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:57 2021] GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:37:58.104128 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-e3d6bccd-3bb9-4531-82e4-eaeba2f1b519 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:58.104727 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-e3d6bccd-3bb9-4531-82e4-eaeba2f1b519 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:58.110465 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e3d6bccd-3bb9-4531-82e4-eaeba2f1b519 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:58.110926 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e3d6bccd-3bb9-4531-82e4-eaeba2f1b519 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:58.111655 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e3d6bccd-3bb9-4531-82e4-eaeba2f1b519 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:58.112101 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-e3d6bccd-3bb9-4531-82e4-eaeba2f1b519 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:58.236109 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-e3d6bccd-3bb9-4531-82e4-eaeba2f1b519 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:58.244048 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-e3d6bccd-3bb9-4531-82e4-eaeba2f1b519 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1568 microversion: 2.1 time: 0.143592 Nov 16 00:37:58.244616 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 559/1113] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:58 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:37:58.353596 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f4f732b7-c57c-4e88-a44a-3ab843ac1fda tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:58.354197 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-f4f732b7-c57c-4e88-a44a-3ab843ac1fda tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:58.360029 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f4f732b7-c57c-4e88-a44a-3ab843ac1fda tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:58.360523 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f4f732b7-c57c-4e88-a44a-3ab843ac1fda tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:58.361978 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f4f732b7-c57c-4e88-a44a-3ab843ac1fda tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:58.362468 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-f4f732b7-c57c-4e88-a44a-3ab843ac1fda tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:58.375142 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-f4f732b7-c57c-4e88-a44a-3ab843ac1fda tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] HTTP exception thrown: Instance 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e could not be found. Nov 16 00:37:58.375715 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f4f732b7-c57c-4e88-a44a-3ab843ac1fda tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Returning 404 to user: Instance 5ba21a21-76fa-4a68-b4ec-79454bdc3b4e could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:37:58.377195 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-f4f732b7-c57c-4e88-a44a-3ab843ac1fda tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e" status: 404 len: 111 microversion: 2.1 time: 0.026709 Nov 16 00:37:58.377751 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 555/1114] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:58 2021] GET /compute/v2.1/servers/5ba21a21-76fa-4a68-b4ec-79454bdc3b4e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:37:58.412450 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-834573fa-d6e3-4c2b-bf6b-f7e321f782ee tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:58.413200 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-834573fa-d6e3-4c2b-bf6b-f7e321f782ee tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: 0c9d3cd5-3621-41d7-9c4b-3c60b1b65094] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:58.419260 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-834573fa-d6e3-4c2b-bf6b-f7e321f782ee tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:58.419808 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-834573fa-d6e3-4c2b-bf6b-f7e321f782ee tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:58.420591 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-834573fa-d6e3-4c2b-bf6b-f7e321f782ee tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:58.421022 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-834573fa-d6e3-4c2b-bf6b-f7e321f782ee tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:58.544281 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-834573fa-d6e3-4c2b-bf6b-f7e321f782ee tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:58.552618 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-834573fa-d6e3-4c2b-bf6b-f7e321f782ee tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094" status: 200 len: 1314 microversion: 2.1 time: 0.143930 Nov 16 00:37:58.553184 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 560/1115] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:58 2021] GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:37:58.827307 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-ad8a08d4-2b3e-4f6e-9e93-1a43510b2ab2 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:58.827807 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-ad8a08d4-2b3e-4f6e-9e93-1a43510b2ab2 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:58.834052 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ad8a08d4-2b3e-4f6e-9e93-1a43510b2ab2 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:58.834528 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ad8a08d4-2b3e-4f6e-9e93-1a43510b2ab2 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:58.835442 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ad8a08d4-2b3e-4f6e-9e93-1a43510b2ab2 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:58.835940 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-ad8a08d4-2b3e-4f6e-9e93-1a43510b2ab2 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:58.850323 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-ad8a08d4-2b3e-4f6e-9e93-1a43510b2ab2 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] HTTP exception thrown: Instance e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e could not be found. Nov 16 00:37:58.850943 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-ad8a08d4-2b3e-4f6e-9e93-1a43510b2ab2 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Returning 404 to user: Instance e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:37:58.851867 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-ad8a08d4-2b3e-4f6e-9e93-1a43510b2ab2 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 404 len: 111 microversion: 2.1 time: 0.028281 Nov 16 00:37:58.852624 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 556/1116] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:37:58 2021] DELETE /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:37:58.864260 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-73905b38-d53c-497a-92b0-e2df553a7f67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:58.864946 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-73905b38-d53c-497a-92b0-e2df553a7f67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] [instance: e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:58.870778 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-73905b38-d53c-497a-92b0-e2df553a7f67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:58.871274 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-73905b38-d53c-497a-92b0-e2df553a7f67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:58.872075 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-73905b38-d53c-497a-92b0-e2df553a7f67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:58.872503 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-73905b38-d53c-497a-92b0-e2df553a7f67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:58.885378 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-73905b38-d53c-497a-92b0-e2df553a7f67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] HTTP exception thrown: Instance e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e could not be found. Nov 16 00:37:58.885961 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-73905b38-d53c-497a-92b0-e2df553a7f67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Returning 404 to user: Instance e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e could not be found. {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:37:58.886771 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-73905b38-d53c-497a-92b0-e2df553a7f67 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e" status: 404 len: 111 microversion: 2.1 time: 0.030029 Nov 16 00:37:58.887333 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 561/1117] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:58 2021] GET /compute/v2.1/servers/e9223a6b-c4c2-4eea-ad0c-91ed5cd15b5e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:37:59.263403 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-0a43ad6b-d54e-4ad4-a3e5-65dd4946f0ca tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:59.263998 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-0a43ad6b-d54e-4ad4-a3e5-65dd4946f0ca tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:59.270073 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0a43ad6b-d54e-4ad4-a3e5-65dd4946f0ca tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:59.270511 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0a43ad6b-d54e-4ad4-a3e5-65dd4946f0ca tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:59.271304 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0a43ad6b-d54e-4ad4-a3e5-65dd4946f0ca tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:59.271736 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-0a43ad6b-d54e-4ad4-a3e5-65dd4946f0ca tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:59.362221 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-0c364fad-e1ad-4bba-b925-8ba42d0f3a1d req-8361297a-e660-43ac-bb2c-3732262056a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c9d3cd5-3621-41d7-9c4b-3c60b1b65094", "name": "network-vif-plugged", "status": "completed", "tag": "2c1d65ba-8817-4587-9198-7b1adf4338b0"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:37:59.365243 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:37:59.365243 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:37:59.378957 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-0c364fad-e1ad-4bba-b925-8ba42d0f3a1d req-8361297a-e660-43ac-bb2c-3732262056a0 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:59.380163 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-0c364fad-e1ad-4bba-b925-8ba42d0f3a1d req-8361297a-e660-43ac-bb2c-3732262056a0 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:59.401405 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-0c364fad-e1ad-4bba-b925-8ba42d0f3a1d req-8361297a-e660-43ac-bb2c-3732262056a0 service nova] Creating event network-vif-plugged:2c1d65ba-8817-4587-9198-7b1adf4338b0 for instance 0c9d3cd5-3621-41d7-9c4b-3c60b1b65094 on hv-cinder-81115 Nov 16 00:37:59.409984 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-0c364fad-e1ad-4bba-b925-8ba42d0f3a1d req-8361297a-e660-43ac-bb2c-3732262056a0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053113 Nov 16 00:37:59.411506 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 562/1118] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:37:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:37:59.421697 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-0a43ad6b-d54e-4ad4-a3e5-65dd4946f0ca tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:59.430078 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-0a43ad6b-d54e-4ad4-a3e5-65dd4946f0ca tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1568 microversion: 2.1 time: 0.170297 Nov 16 00:37:59.430642 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 557/1119] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:59 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:37:59.570516 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ee922e6b-da8e-4795-900a-9a6980e3a7cd tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:37:59.571246 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ee922e6b-da8e-4795-900a-9a6980e3a7cd tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: 0c9d3cd5-3621-41d7-9c4b-3c60b1b65094] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:37:59.577383 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ee922e6b-da8e-4795-900a-9a6980e3a7cd tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:59.577863 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ee922e6b-da8e-4795-900a-9a6980e3a7cd tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:59.578634 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ee922e6b-da8e-4795-900a-9a6980e3a7cd tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:37:59.579091 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ee922e6b-da8e-4795-900a-9a6980e3a7cd tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:37:59.706570 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-ee922e6b-da8e-4795-900a-9a6980e3a7cd tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:37:59.713946 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ee922e6b-da8e-4795-900a-9a6980e3a7cd tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094" status: 200 len: 1314 microversion: 2.1 time: 0.147400 Nov 16 00:37:59.714501 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 563/1120] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:37:59 2021] GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:38:00.184073 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-f721be78-f8c4-4df6-91f8-3bd3badc52e0 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] Calling method '.version_select at 0x7f2f29456820>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:00.209152 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-f721be78-f8c4-4df6-91f8-3bd3badc52e0 tempest-TestVolumeBootPattern-865081029 tempest-TestVolumeBootPattern-865081029-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2139507500" status: 202 len: 0 microversion: 2.1 time: 0.028911 Nov 16 00:38:00.213779 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 558/1121] 10.222.0.31 () {58 vars in 1262 bytes} [Tue Nov 16 00:38:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2139507500 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:38:00.446859 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-7126b912-7252-4c50-8702-65003dcc56de tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:00.447565 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-7126b912-7252-4c50-8702-65003dcc56de tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:00.453242 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7126b912-7252-4c50-8702-65003dcc56de tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:00.453694 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7126b912-7252-4c50-8702-65003dcc56de tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:00.454468 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7126b912-7252-4c50-8702-65003dcc56de tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:00.454933 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-7126b912-7252-4c50-8702-65003dcc56de tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:00.670768 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-7126b912-7252-4c50-8702-65003dcc56de tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:00.681053 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-7126b912-7252-4c50-8702-65003dcc56de tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1568 microversion: 2.1 time: 0.237629 Nov 16 00:38:00.691796 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 564/1122] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:00 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:00.732565 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-7951e37f-ac8d-463e-8193-005068f3a81f tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:00.733958 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-7951e37f-ac8d-463e-8193-005068f3a81f tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: 0c9d3cd5-3621-41d7-9c4b-3c60b1b65094] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:00.741367 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7951e37f-ac8d-463e-8193-005068f3a81f tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:00.742179 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7951e37f-ac8d-463e-8193-005068f3a81f tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:00.743587 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7951e37f-ac8d-463e-8193-005068f3a81f tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:00.744230 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-7951e37f-ac8d-463e-8193-005068f3a81f tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:00.889481 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-7951e37f-ac8d-463e-8193-005068f3a81f tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:00.898520 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-7951e37f-ac8d-463e-8193-005068f3a81f tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094" status: 200 len: 1498 microversion: 2.1 time: 0.170973 Nov 16 00:38:00.899340 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 559/1123] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:00 2021] GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094 => generated 1498 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:01.373545 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-36d3a6d6-e156-4d3c-8c3f-acdaaeff1703 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:01.374310 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-36d3a6d6-e156-4d3c-8c3f-acdaaeff1703 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: 0c9d3cd5-3621-41d7-9c4b-3c60b1b65094] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:01.382291 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-36d3a6d6-e156-4d3c-8c3f-acdaaeff1703 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:01.383186 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-36d3a6d6-e156-4d3c-8c3f-acdaaeff1703 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:01.384745 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-36d3a6d6-e156-4d3c-8c3f-acdaaeff1703 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:01.385402 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-36d3a6d6-e156-4d3c-8c3f-acdaaeff1703 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:01.432460 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-36d3a6d6-e156-4d3c-8c3f-acdaaeff1703 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: 0c9d3cd5-3621-41d7-9c4b-3c60b1b65094] Going to try to terminate instance {{(pid=122543) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:38:01.544978 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-36d3a6d6-e156-4d3c-8c3f-acdaaeff1703 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "DELETE /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094" status: 204 len: 0 microversion: 2.1 time: 0.174025 Nov 16 00:38:01.547119 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 565/1124] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:38:01 2021] DELETE /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 00:38:01.555231 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-bd2b53b8-af24-4f36-b796-96f3a5f8ad29 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:01.556142 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-bd2b53b8-af24-4f36-b796-96f3a5f8ad29 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: 0c9d3cd5-3621-41d7-9c4b-3c60b1b65094] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:01.564214 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bd2b53b8-af24-4f36-b796-96f3a5f8ad29 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:01.565515 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bd2b53b8-af24-4f36-b796-96f3a5f8ad29 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:01.566494 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bd2b53b8-af24-4f36-b796-96f3a5f8ad29 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:01.567112 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-bd2b53b8-af24-4f36-b796-96f3a5f8ad29 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:01.699214 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-61146356-5f60-40f9-99cb-db51286b5f50 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:01.700139 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-61146356-5f60-40f9-99cb-db51286b5f50 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:01.707084 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-61146356-5f60-40f9-99cb-db51286b5f50 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:01.707733 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-61146356-5f60-40f9-99cb-db51286b5f50 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:01.708692 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-61146356-5f60-40f9-99cb-db51286b5f50 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:01.709491 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-61146356-5f60-40f9-99cb-db51286b5f50 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:01.721187 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-bd2b53b8-af24-4f36-b796-96f3a5f8ad29 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:01.729581 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-bd2b53b8-af24-4f36-b796-96f3a5f8ad29 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094" status: 200 len: 1504 microversion: 2.1 time: 0.178621 Nov 16 00:38:01.730066 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 560/1125] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:01 2021] GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:02.178018 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-61146356-5f60-40f9-99cb-db51286b5f50 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:02.185501 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-61146356-5f60-40f9-99cb-db51286b5f50 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1568 microversion: 2.1 time: 0.490351 Nov 16 00:38:02.186070 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 566/1126] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:01 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1568 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:02.750443 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-8473233a-3102-4120-b771-bc3d554a2279 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:02.752359 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-8473233a-3102-4120-b771-bc3d554a2279 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: 0c9d3cd5-3621-41d7-9c4b-3c60b1b65094] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:02.759621 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8473233a-3102-4120-b771-bc3d554a2279 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:02.760326 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8473233a-3102-4120-b771-bc3d554a2279 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:02.761281 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8473233a-3102-4120-b771-bc3d554a2279 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:02.764098 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8473233a-3102-4120-b771-bc3d554a2279 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:03.004639 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-8473233a-3102-4120-b771-bc3d554a2279 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:03.015878 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-8473233a-3102-4120-b771-bc3d554a2279 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094" status: 200 len: 1504 microversion: 2.1 time: 0.269114 Nov 16 00:38:03.017310 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 561/1127] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:02 2021] GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094 => generated 1504 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:03.202305 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-d644b0d4-7341-4a41-a4c8-8b94cd057731 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:03.203095 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d644b0d4-7341-4a41-a4c8-8b94cd057731 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:03.213709 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d644b0d4-7341-4a41-a4c8-8b94cd057731 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:03.214077 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d644b0d4-7341-4a41-a4c8-8b94cd057731 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:03.215186 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d644b0d4-7341-4a41-a4c8-8b94cd057731 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:03.215745 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d644b0d4-7341-4a41-a4c8-8b94cd057731 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:03.405648 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-d644b0d4-7341-4a41-a4c8-8b94cd057731 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:03.417128 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-d644b0d4-7341-4a41-a4c8-8b94cd057731 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1568 microversion: 2.1 time: 0.218359 Nov 16 00:38:03.417711 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 567/1128] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:03 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:03.506027 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-f95cc60a-a090-47da-b212-0cacdc241391 req-bfcc4427-6d03-4608-b5b0-7ce2b0bd0908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c9d3cd5-3621-41d7-9c4b-3c60b1b65094", "name": "network-vif-deleted", "tag": "2c1d65ba-8817-4587-9198-7b1adf4338b0"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:38:03.508801 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:38:03.508801 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:38:03.517973 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-f95cc60a-a090-47da-b212-0cacdc241391 req-bfcc4427-6d03-4608-b5b0-7ce2b0bd0908 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:03.518663 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-f95cc60a-a090-47da-b212-0cacdc241391 req-bfcc4427-6d03-4608-b5b0-7ce2b0bd0908 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:03.530576 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-f95cc60a-a090-47da-b212-0cacdc241391 req-bfcc4427-6d03-4608-b5b0-7ce2b0bd0908 service nova] Creating event network-vif-deleted:2c1d65ba-8817-4587-9198-7b1adf4338b0 for instance 0c9d3cd5-3621-41d7-9c4b-3c60b1b65094 on hv-cinder-81115 Nov 16 00:38:03.536491 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-f95cc60a-a090-47da-b212-0cacdc241391 req-bfcc4427-6d03-4608-b5b0-7ce2b0bd0908 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035612 Nov 16 00:38:03.537144 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 562/1129] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:38:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:38:04.037755 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ac3c71b1-eba0-4189-a0d6-39aaf982ea5c tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:04.038698 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ac3c71b1-eba0-4189-a0d6-39aaf982ea5c tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: 0c9d3cd5-3621-41d7-9c4b-3c60b1b65094] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:04.046613 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ac3c71b1-eba0-4189-a0d6-39aaf982ea5c tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:04.051882 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ac3c71b1-eba0-4189-a0d6-39aaf982ea5c tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:04.052782 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ac3c71b1-eba0-4189-a0d6-39aaf982ea5c tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:04.053274 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ac3c71b1-eba0-4189-a0d6-39aaf982ea5c tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:04.069912 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-ac3c71b1-eba0-4189-a0d6-39aaf982ea5c tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] HTTP exception thrown: Instance 0c9d3cd5-3621-41d7-9c4b-3c60b1b65094 could not be found. Nov 16 00:38:04.071313 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ac3c71b1-eba0-4189-a0d6-39aaf982ea5c tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Returning 404 to user: Instance 0c9d3cd5-3621-41d7-9c4b-3c60b1b65094 could not be found. {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:38:04.072790 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ac3c71b1-eba0-4189-a0d6-39aaf982ea5c tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094" status: 404 len: 111 microversion: 2.1 time: 0.041117 Nov 16 00:38:04.074242 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 568/1130] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:04 2021] GET /compute/v2.1/servers/0c9d3cd5-3621-41d7-9c4b-3c60b1b65094 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:38:04.200741 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-e73fd031-a077-4312-b057-6c7739fa06b8 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-898908152", "imageRef": "bb47ca05-3b48-4f1c-bc96-e0c5c672caba", "flavorRef": "452", "networks": [{"uuid": "d472da9d-80d9-479d-822c-b6e8632df992"}]}} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:38:04.254426 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.network.neutron [None req-e73fd031-a077-4312-b057-6c7739fa06b8 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] validate_networks() for [('d472da9d-80d9-479d-822c-b6e8632df992', None, None, None, None, None)] {{(pid=122544) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Nov 16 00:38:04.434902 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-ca9a7a14-929b-4351-9b8e-92ad17f5716b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:04.435473 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-ca9a7a14-929b-4351-9b8e-92ad17f5716b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:04.442095 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ca9a7a14-929b-4351-9b8e-92ad17f5716b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:04.442536 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ca9a7a14-929b-4351-9b8e-92ad17f5716b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:04.443335 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ca9a7a14-929b-4351-9b8e-92ad17f5716b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:04.443768 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-ca9a7a14-929b-4351-9b8e-92ad17f5716b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:04.569823 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-ca9a7a14-929b-4351-9b8e-92ad17f5716b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:04.577162 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-ca9a7a14-929b-4351-9b8e-92ad17f5716b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1568 microversion: 2.1 time: 0.146014 Nov 16 00:38:04.577734 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 569/1131] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:04 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:38:04.792564 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-e73fd031-a077-4312-b057-6c7739fa06b8 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Flavor limits 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 00:38:04.792979 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-e73fd031-a077-4312-b057-6c7739fa06b8 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Image limits 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 00:38:04.793447 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-e73fd031-a077-4312-b057-6c7739fa06b8 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Flavor pref 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 00:38:04.793841 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-e73fd031-a077-4312-b057-6c7739fa06b8 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Image pref 0:0:0 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 00:38:04.794262 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.virt.hardware [None req-e73fd031-a077-4312-b057-6c7739fa06b8 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122544) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 00:38:04.803487 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e73fd031-a077-4312-b057-6c7739fa06b8 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:04.803953 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e73fd031-a077-4312-b057-6c7739fa06b8 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:04.804746 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e73fd031-a077-4312-b057-6c7739fa06b8 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:04.805163 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-e73fd031-a077-4312-b057-6c7739fa06b8 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:04.822850 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-e73fd031-a077-4312-b057-6c7739fa06b8 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Getting quotas for project 4f9b691378844135bec95fb0c25829cc. Resources: {'instances', 'cores', 'ram'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 00:38:04.827267 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.quota [None req-e73fd031-a077-4312-b057-6c7739fa06b8 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Getting quotas for user 53025a2dea324aab903a49328416eead and project 4f9b691378844135bec95fb0c25829cc. Resources: {'instances', 'cores', 'ram'} {{(pid=122544) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 00:38:04.847760 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e73fd031-a077-4312-b057-6c7739fa06b8 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Going to run 1 instances... {{(pid=122544) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 00:38:04.850415 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-e73fd031-a077-4312-b057-6c7739fa06b8 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb47ca05-3b48-4f1c-bc96-e0c5c672caba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122544) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 00:38:04.897556 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-e73fd031-a077-4312-b057-6c7739fa06b8 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701155 Nov 16 00:38:04.898299 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 563/1132] 10.222.0.31 () {60 vars in 1146 bytes} [Tue Nov 16 00:38:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 00:38:04.908874 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-06f625d3-ba72-47dd-a494-9e60c98dd6ba tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:04.909719 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-06f625d3-ba72-47dd-a494-9e60c98dd6ba tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:04.996358 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-06f625d3-ba72-47dd-a494-9e60c98dd6ba tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:05.012469 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-06f625d3-ba72-47dd-a494-9e60c98dd6ba tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9" status: 200 len: 1213 microversion: 2.1 time: 0.107488 Nov 16 00:38:05.013027 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 570/1133] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:04 2021] GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 => generated 1213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:05.594618 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a223d9de-3b52-41ed-8a0d-a09b355c24b1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:05.595827 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a223d9de-3b52-41ed-8a0d-a09b355c24b1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:05.603140 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a223d9de-3b52-41ed-8a0d-a09b355c24b1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:05.603636 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a223d9de-3b52-41ed-8a0d-a09b355c24b1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:05.604367 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a223d9de-3b52-41ed-8a0d-a09b355c24b1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:05.604792 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a223d9de-3b52-41ed-8a0d-a09b355c24b1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:05.845630 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a223d9de-3b52-41ed-8a0d-a09b355c24b1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:05.853468 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a223d9de-3b52-41ed-8a0d-a09b355c24b1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1568 microversion: 2.1 time: 0.262505 Nov 16 00:38:05.854136 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 564/1134] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:05 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1568 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:06.037705 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-564046f3-003c-454d-b7ac-702d259d7875 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:06.040695 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-564046f3-003c-454d-b7ac-702d259d7875 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:06.049625 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-564046f3-003c-454d-b7ac-702d259d7875 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:06.050473 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-564046f3-003c-454d-b7ac-702d259d7875 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:06.051456 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-564046f3-003c-454d-b7ac-702d259d7875 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:06.052146 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-564046f3-003c-454d-b7ac-702d259d7875 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:06.133852 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-564046f3-003c-454d-b7ac-702d259d7875 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:06.143701 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-564046f3-003c-454d-b7ac-702d259d7875 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9" status: 200 len: 1271 microversion: 2.1 time: 0.117580 Nov 16 00:38:06.144820 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 571/1135] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:06 2021] GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 => generated 1271 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:06.875431 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3e5b3c42-904d-48fd-8fec-ac072429fcb5 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:06.876166 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3e5b3c42-904d-48fd-8fec-ac072429fcb5 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:06.882413 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3e5b3c42-904d-48fd-8fec-ac072429fcb5 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:06.883227 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3e5b3c42-904d-48fd-8fec-ac072429fcb5 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:06.884070 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3e5b3c42-904d-48fd-8fec-ac072429fcb5 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:06.884564 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3e5b3c42-904d-48fd-8fec-ac072429fcb5 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:07.123979 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3e5b3c42-904d-48fd-8fec-ac072429fcb5 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:07.133557 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-3e5b3c42-904d-48fd-8fec-ac072429fcb5 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1568 microversion: 2.1 time: 0.265931 Nov 16 00:38:07.134338 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 565/1136] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:06 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:07.161835 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-18d3f437-e728-4f8e-9f30-5b46272d6bb2 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:07.162443 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-18d3f437-e728-4f8e-9f30-5b46272d6bb2 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:07.169358 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-18d3f437-e728-4f8e-9f30-5b46272d6bb2 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:07.170039 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-18d3f437-e728-4f8e-9f30-5b46272d6bb2 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:07.170980 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-18d3f437-e728-4f8e-9f30-5b46272d6bb2 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:07.172180 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-18d3f437-e728-4f8e-9f30-5b46272d6bb2 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:07.544345 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-18d3f437-e728-4f8e-9f30-5b46272d6bb2 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:07.561852 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-18d3f437-e728-4f8e-9f30-5b46272d6bb2 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9" status: 200 len: 1313 microversion: 2.1 time: 0.403643 Nov 16 00:38:07.571821 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 572/1137] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:07 2021] GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:07.765552 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-7f971d0a-254b-407f-8998-f75895107347 req-3b1b5698-b2b7-4e2f-9eef-5622ed1484c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9", "tag": "61f19899-f0f1-4180-a1a2-c9d49909a093"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:38:07.767995 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:38:07.767995 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:38:07.780155 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-7f971d0a-254b-407f-8998-f75895107347 req-3b1b5698-b2b7-4e2f-9eef-5622ed1484c1 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:07.780992 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-7f971d0a-254b-407f-8998-f75895107347 req-3b1b5698-b2b7-4e2f-9eef-5622ed1484c1 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:07.803810 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-7f971d0a-254b-407f-8998-f75895107347 req-3b1b5698-b2b7-4e2f-9eef-5622ed1484c1 service nova] Creating event network-changed:61f19899-f0f1-4180-a1a2-c9d49909a093 for instance a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 on hv-cinder-81115 Nov 16 00:38:07.809749 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-7f971d0a-254b-407f-8998-f75895107347 req-3b1b5698-b2b7-4e2f-9eef-5622ed1484c1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049596 Nov 16 00:38:07.810665 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 566/1138] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:38:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:38:08.150984 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-93f6cb6f-b437-46ac-8c40-95d8ee1919da tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:08.151564 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-93f6cb6f-b437-46ac-8c40-95d8ee1919da tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:08.158377 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-93f6cb6f-b437-46ac-8c40-95d8ee1919da tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:08.158845 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-93f6cb6f-b437-46ac-8c40-95d8ee1919da tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:08.159784 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-93f6cb6f-b437-46ac-8c40-95d8ee1919da tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:08.160231 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-93f6cb6f-b437-46ac-8c40-95d8ee1919da tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:08.470188 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-93f6cb6f-b437-46ac-8c40-95d8ee1919da tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:08.478953 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-93f6cb6f-b437-46ac-8c40-95d8ee1919da tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1568 microversion: 2.1 time: 0.331587 Nov 16 00:38:08.479801 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 573/1139] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:08 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1568 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:08.589352 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-057f01be-d885-489a-9657-d72093429613 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:08.590042 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-057f01be-d885-489a-9657-d72093429613 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:08.606114 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-057f01be-d885-489a-9657-d72093429613 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:08.606585 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-057f01be-d885-489a-9657-d72093429613 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:08.607661 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-057f01be-d885-489a-9657-d72093429613 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:08.608179 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-057f01be-d885-489a-9657-d72093429613 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:08.793935 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-057f01be-d885-489a-9657-d72093429613 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:08.802466 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-057f01be-d885-489a-9657-d72093429613 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9" status: 200 len: 1313 microversion: 2.1 time: 0.217764 Nov 16 00:38:08.803195 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 567/1140] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:08 2021] GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:09.498342 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-c42706dd-b20c-4284-9c05-68db5e9c0e6f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:09.499590 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-c42706dd-b20c-4284-9c05-68db5e9c0e6f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:09.508865 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c42706dd-b20c-4284-9c05-68db5e9c0e6f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:09.509568 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c42706dd-b20c-4284-9c05-68db5e9c0e6f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:09.519102 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c42706dd-b20c-4284-9c05-68db5e9c0e6f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:09.519102 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-c42706dd-b20c-4284-9c05-68db5e9c0e6f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:09.656968 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-c42706dd-b20c-4284-9c05-68db5e9c0e6f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:09.665316 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-c42706dd-b20c-4284-9c05-68db5e9c0e6f tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1568 microversion: 2.1 time: 0.170887 Nov 16 00:38:09.665898 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 574/1141] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:09 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:09.819756 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-82b3f439-0d24-484f-86cd-409697383dfb tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:09.820364 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-82b3f439-0d24-484f-86cd-409697383dfb tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:09.826173 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-82b3f439-0d24-484f-86cd-409697383dfb tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:09.826617 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-82b3f439-0d24-484f-86cd-409697383dfb tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:09.827409 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-82b3f439-0d24-484f-86cd-409697383dfb tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:09.827838 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-82b3f439-0d24-484f-86cd-409697383dfb tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:09.952637 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-82b3f439-0d24-484f-86cd-409697383dfb tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:09.959759 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-82b3f439-0d24-484f-86cd-409697383dfb tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9" status: 200 len: 1313 microversion: 2.1 time: 0.143764 Nov 16 00:38:09.960539 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 568/1142] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:09 2021] GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:10.683256 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-cdbd2df4-b386-45f6-8794-dc10e932072e tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:10.683908 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-cdbd2df4-b386-45f6-8794-dc10e932072e tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:10.690948 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cdbd2df4-b386-45f6-8794-dc10e932072e tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:10.691481 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cdbd2df4-b386-45f6-8794-dc10e932072e tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:10.692247 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cdbd2df4-b386-45f6-8794-dc10e932072e tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:10.692820 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-cdbd2df4-b386-45f6-8794-dc10e932072e tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:10.822005 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-cdbd2df4-b386-45f6-8794-dc10e932072e tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:10.829217 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-cdbd2df4-b386-45f6-8794-dc10e932072e tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1569 microversion: 2.1 time: 0.149599 Nov 16 00:38:10.829775 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 575/1143] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:10 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:10.846003 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-4085b8a6-8138-4d76-80b1-2f0399cfad33 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:38:10.846928 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-4085b8a6-8138-4d76-80b1-2f0399cfad33 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:10.853844 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4085b8a6-8138-4d76-80b1-2f0399cfad33 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:10.854292 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4085b8a6-8138-4d76-80b1-2f0399cfad33 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:10.855158 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4085b8a6-8138-4d76-80b1-2f0399cfad33 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:10.855615 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-4085b8a6-8138-4d76-80b1-2f0399cfad33 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:10.945009 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-4085b8a6-8138-4d76-80b1-2f0399cfad33 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "POST /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f/action" status: 202 len: 0 microversion: 2.1 time: 0.102802 Nov 16 00:38:10.945575 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 569/1144] 10.222.0.31 () {60 vars in 1277 bytes} [Tue Nov 16 00:38:10 2021] POST /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:38:10.954656 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-865598ec-e482-4a34-a4f4-74377d9933a1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:10.955862 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-865598ec-e482-4a34-a4f4-74377d9933a1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:10.962413 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-865598ec-e482-4a34-a4f4-74377d9933a1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:10.962717 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-865598ec-e482-4a34-a4f4-74377d9933a1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:10.963410 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-865598ec-e482-4a34-a4f4-74377d9933a1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:10.963841 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-865598ec-e482-4a34-a4f4-74377d9933a1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:10.977707 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-dbfe7d22-b880-424c-aa0d-e65df688465e tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:10.978332 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-dbfe7d22-b880-424c-aa0d-e65df688465e tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:10.984400 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dbfe7d22-b880-424c-aa0d-e65df688465e tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:10.984833 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dbfe7d22-b880-424c-aa0d-e65df688465e tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:10.985620 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dbfe7d22-b880-424c-aa0d-e65df688465e tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:10.986045 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-dbfe7d22-b880-424c-aa0d-e65df688465e tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:11.102012 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-865598ec-e482-4a34-a4f4-74377d9933a1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:11.110403 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-865598ec-e482-4a34-a4f4-74377d9933a1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1517 microversion: 2.1 time: 0.159726 Nov 16 00:38:11.110973 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 576/1145] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:10 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:11.122944 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-dbfe7d22-b880-424c-aa0d-e65df688465e tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:11.130720 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-dbfe7d22-b880-424c-aa0d-e65df688465e tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9" status: 200 len: 1313 microversion: 2.1 time: 0.157094 Nov 16 00:38:11.131745 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 570/1146] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:10 2021] GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:12.128367 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-3914e1d4-f4e2-4541-b9d6-9426d5153485 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:12.128960 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-3914e1d4-f4e2-4541-b9d6-9426d5153485 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:12.134834 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3914e1d4-f4e2-4541-b9d6-9426d5153485 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:12.135308 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3914e1d4-f4e2-4541-b9d6-9426d5153485 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:12.136068 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3914e1d4-f4e2-4541-b9d6-9426d5153485 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:12.136495 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3914e1d4-f4e2-4541-b9d6-9426d5153485 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:12.147711 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-9cf1a319-1b71-4837-93ed-435d9c7030e5 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:12.148320 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-9cf1a319-1b71-4837-93ed-435d9c7030e5 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:12.154324 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9cf1a319-1b71-4837-93ed-435d9c7030e5 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:12.154769 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9cf1a319-1b71-4837-93ed-435d9c7030e5 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:12.155567 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9cf1a319-1b71-4837-93ed-435d9c7030e5 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:12.155997 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9cf1a319-1b71-4837-93ed-435d9c7030e5 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:12.285552 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-9cf1a319-1b71-4837-93ed-435d9c7030e5 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:12.293590 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-9cf1a319-1b71-4837-93ed-435d9c7030e5 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9" status: 200 len: 1313 microversion: 2.1 time: 0.149598 Nov 16 00:38:12.294259 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 571/1147] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:12 2021] GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:12.301693 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-3914e1d4-f4e2-4541-b9d6-9426d5153485 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:12.311016 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-3914e1d4-f4e2-4541-b9d6-9426d5153485 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1575 microversion: 2.1 time: 0.186807 Nov 16 00:38:12.312661 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 577/1148] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:12 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:13.310389 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-8e0e5b86-6c25-4fee-83db-9ebcd75b1f3a tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:13.310997 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-8e0e5b86-6c25-4fee-83db-9ebcd75b1f3a tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:13.317031 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8e0e5b86-6c25-4fee-83db-9ebcd75b1f3a tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:13.317427 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8e0e5b86-6c25-4fee-83db-9ebcd75b1f3a tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:13.318200 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8e0e5b86-6c25-4fee-83db-9ebcd75b1f3a tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:13.318669 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-8e0e5b86-6c25-4fee-83db-9ebcd75b1f3a tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:13.333455 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-3c16b3fc-c5d9-4e1d-aa1c-f32483371a66 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:13.334976 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-3c16b3fc-c5d9-4e1d-aa1c-f32483371a66 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:13.348052 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3c16b3fc-c5d9-4e1d-aa1c-f32483371a66 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:13.349018 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3c16b3fc-c5d9-4e1d-aa1c-f32483371a66 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:13.349969 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3c16b3fc-c5d9-4e1d-aa1c-f32483371a66 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:13.351205 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-3c16b3fc-c5d9-4e1d-aa1c-f32483371a66 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:13.475997 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-8e0e5b86-6c25-4fee-83db-9ebcd75b1f3a tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:13.483412 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-8e0e5b86-6c25-4fee-83db-9ebcd75b1f3a tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9" status: 200 len: 1313 microversion: 2.1 time: 0.176535 Nov 16 00:38:13.484303 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 572/1149] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:13 2021] GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:13.489065 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-fef50322-60ed-4ebb-a4ad-009993c12cd2 req-00c010e8-80a3-4fcc-9244-f7884ebaeb45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9", "name": "network-vif-plugged", "status": "completed", "tag": "61f19899-f0f1-4180-a1a2-c9d49909a093"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:38:13.490537 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:38:13.490537 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:38:13.498816 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-fef50322-60ed-4ebb-a4ad-009993c12cd2 req-00c010e8-80a3-4fcc-9244-f7884ebaeb45 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:13.499278 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-fef50322-60ed-4ebb-a4ad-009993c12cd2 req-00c010e8-80a3-4fcc-9244-f7884ebaeb45 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:13.510263 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-3c16b3fc-c5d9-4e1d-aa1c-f32483371a66 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:13.510790 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-fef50322-60ed-4ebb-a4ad-009993c12cd2 req-00c010e8-80a3-4fcc-9244-f7884ebaeb45 service nova] Creating event network-vif-plugged:61f19899-f0f1-4180-a1a2-c9d49909a093 for instance a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 on hv-cinder-81115 Nov 16 00:38:13.516060 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-fef50322-60ed-4ebb-a4ad-009993c12cd2 req-00c010e8-80a3-4fcc-9244-f7884ebaeb45 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030288 Nov 16 00:38:13.516630 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 573/1150] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:38:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:38:13.522113 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-3c16b3fc-c5d9-4e1d-aa1c-f32483371a66 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1575 microversion: 2.1 time: 0.194249 Nov 16 00:38:13.522682 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 578/1151] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:13 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1575 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:14.501514 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-cdda512b-61b3-4a0c-8889-0537b96abc5c tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:14.502389 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-cdda512b-61b3-4a0c-8889-0537b96abc5c tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:14.508546 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cdda512b-61b3-4a0c-8889-0537b96abc5c tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:14.508989 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cdda512b-61b3-4a0c-8889-0537b96abc5c tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:14.509749 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cdda512b-61b3-4a0c-8889-0537b96abc5c tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:14.510203 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-cdda512b-61b3-4a0c-8889-0537b96abc5c tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:14.539684 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-b993d74e-7dcd-4e1d-bdc3-ade2997793b1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:14.540293 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-b993d74e-7dcd-4e1d-bdc3-ade2997793b1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:14.551391 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b993d74e-7dcd-4e1d-bdc3-ade2997793b1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:14.552010 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b993d74e-7dcd-4e1d-bdc3-ade2997793b1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:14.552786 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b993d74e-7dcd-4e1d-bdc3-ade2997793b1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:14.553205 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-b993d74e-7dcd-4e1d-bdc3-ade2997793b1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:14.636515 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-cdda512b-61b3-4a0c-8889-0537b96abc5c tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:14.647147 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-cdda512b-61b3-4a0c-8889-0537b96abc5c tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9" status: 200 len: 1313 microversion: 2.1 time: 0.149642 Nov 16 00:38:14.647836 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 574/1152] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:14 2021] GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:38:14.679551 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-b993d74e-7dcd-4e1d-bdc3-ade2997793b1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:14.686724 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-b993d74e-7dcd-4e1d-bdc3-ade2997793b1 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1575 microversion: 2.1 time: 0.150662 Nov 16 00:38:14.687303 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 579/1153] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:14 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:38:15.534555 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-7f3dd10c-163c-4eb2-ae1a-dee56516d060 req-6948b9d2-528c-4408-ac03-f40963521813 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2b3498-9dc0-415d-8e78-dee875d29a7f", "name": "network-vif-unplugged", "status": "completed", "tag": "e9de811a-ed83-4234-81b8-9dda4ea6612f"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:38:15.536250 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:38:15.536250 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:38:15.543255 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-7f3dd10c-163c-4eb2-ae1a-dee56516d060 req-6948b9d2-528c-4408-ac03-f40963521813 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:15.543692 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-7f3dd10c-163c-4eb2-ae1a-dee56516d060 req-6948b9d2-528c-4408-ac03-f40963521813 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:15.555190 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-7f3dd10c-163c-4eb2-ae1a-dee56516d060 req-6948b9d2-528c-4408-ac03-f40963521813 service nova] Creating event network-vif-unplugged:e9de811a-ed83-4234-81b8-9dda4ea6612f for instance 4d2b3498-9dc0-415d-8e78-dee875d29a7f on hv-cinder-81115 Nov 16 00:38:15.560097 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-7f3dd10c-163c-4eb2-ae1a-dee56516d060 req-6948b9d2-528c-4408-ac03-f40963521813 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030144 Nov 16 00:38:15.560716 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 575/1154] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:38:15 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:38:15.664496 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-1ba0c2a6-7759-4d45-b34f-3ccba788faaa tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:15.665085 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-1ba0c2a6-7759-4d45-b34f-3ccba788faaa tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:15.671187 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1ba0c2a6-7759-4d45-b34f-3ccba788faaa tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:15.671650 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1ba0c2a6-7759-4d45-b34f-3ccba788faaa tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:15.672403 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1ba0c2a6-7759-4d45-b34f-3ccba788faaa tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:15.672831 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-1ba0c2a6-7759-4d45-b34f-3ccba788faaa tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:15.703914 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-aebc7adc-faa0-4cf3-9e95-59547af6ad87 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:15.704622 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-aebc7adc-faa0-4cf3-9e95-59547af6ad87 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:15.711979 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-aebc7adc-faa0-4cf3-9e95-59547af6ad87 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:15.712428 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-aebc7adc-faa0-4cf3-9e95-59547af6ad87 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:15.713214 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-aebc7adc-faa0-4cf3-9e95-59547af6ad87 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:15.713644 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-aebc7adc-faa0-4cf3-9e95-59547af6ad87 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:15.797943 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-1ba0c2a6-7759-4d45-b34f-3ccba788faaa tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:15.805374 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-1ba0c2a6-7759-4d45-b34f-3ccba788faaa tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9" status: 200 len: 1498 microversion: 2.1 time: 0.144487 Nov 16 00:38:15.805947 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 580/1155] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:15 2021] GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 => generated 1498 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:15.838075 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-aebc7adc-faa0-4cf3-9e95-59547af6ad87 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:15.845576 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-aebc7adc-faa0-4cf3-9e95-59547af6ad87 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1575 microversion: 2.1 time: 0.145671 Nov 16 00:38:15.846213 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 576/1156] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:15 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1575 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:38:16.456698 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-59cb9410-cd17-48f5-aed8-ea421707c6c6 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:16.457181 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-59cb9410-cd17-48f5-aed8-ea421707c6c6 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:16.462874 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-59cb9410-cd17-48f5-aed8-ea421707c6c6 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:16.463365 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-59cb9410-cd17-48f5-aed8-ea421707c6c6 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:16.464118 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-59cb9410-cd17-48f5-aed8-ea421707c6c6 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:16.464562 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-59cb9410-cd17-48f5-aed8-ea421707c6c6 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:16.489993 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-59cb9410-cd17-48f5-aed8-ea421707c6c6 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9] Going to try to terminate instance {{(pid=122543) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:38:16.563648 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-59cb9410-cd17-48f5-aed8-ea421707c6c6 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "DELETE /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9" status: 204 len: 0 microversion: 2.1 time: 0.110091 Nov 16 00:38:16.565034 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 581/1157] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:38:16 2021] DELETE /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 00:38:16.574142 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-3d2c33fc-8894-4420-91fd-d0a8a5f20428 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:16.574760 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-3d2c33fc-8894-4420-91fd-d0a8a5f20428 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:16.580724 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3d2c33fc-8894-4420-91fd-d0a8a5f20428 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:16.581194 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3d2c33fc-8894-4420-91fd-d0a8a5f20428 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:16.581947 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3d2c33fc-8894-4420-91fd-d0a8a5f20428 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:16.582373 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-3d2c33fc-8894-4420-91fd-d0a8a5f20428 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:16.708023 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-3d2c33fc-8894-4420-91fd-d0a8a5f20428 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:16.715271 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-3d2c33fc-8894-4420-91fd-d0a8a5f20428 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9" status: 200 len: 1504 microversion: 2.1 time: 0.145474 Nov 16 00:38:16.715832 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 577/1158] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:16 2021] GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 => generated 1504 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:16.863597 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-2f341793-5e30-4b22-b204-7b60510ee4f8 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:16.864296 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-2f341793-5e30-4b22-b204-7b60510ee4f8 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:16.870021 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2f341793-5e30-4b22-b204-7b60510ee4f8 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:16.870454 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2f341793-5e30-4b22-b204-7b60510ee4f8 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:16.871240 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2f341793-5e30-4b22-b204-7b60510ee4f8 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:16.871662 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-2f341793-5e30-4b22-b204-7b60510ee4f8 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:16.991502 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-2f341793-5e30-4b22-b204-7b60510ee4f8 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:16.998659 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-2f341793-5e30-4b22-b204-7b60510ee4f8 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1575 microversion: 2.1 time: 0.139791 Nov 16 00:38:16.999239 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 582/1159] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:16 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1575 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:17.732802 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-73147a8b-3325-4256-8b75-3958627db7bb tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:17.733352 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-73147a8b-3325-4256-8b75-3958627db7bb tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:17.739460 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-73147a8b-3325-4256-8b75-3958627db7bb tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:17.739900 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-73147a8b-3325-4256-8b75-3958627db7bb tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:17.740663 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-73147a8b-3325-4256-8b75-3958627db7bb tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:17.741088 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-73147a8b-3325-4256-8b75-3958627db7bb tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:17.865183 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-73147a8b-3325-4256-8b75-3958627db7bb tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:17.872511 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-73147a8b-3325-4256-8b75-3958627db7bb tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9" status: 200 len: 1504 microversion: 2.1 time: 0.143404 Nov 16 00:38:17.873082 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 578/1160] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:17 2021] GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 => generated 1504 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:18.014757 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-a0abed74-c69f-44e8-9cca-f12589918d0e tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:18.015346 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-a0abed74-c69f-44e8-9cca-f12589918d0e tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:18.021500 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a0abed74-c69f-44e8-9cca-f12589918d0e tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:18.021942 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a0abed74-c69f-44e8-9cca-f12589918d0e tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:18.022718 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a0abed74-c69f-44e8-9cca-f12589918d0e tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:18.023182 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-a0abed74-c69f-44e8-9cca-f12589918d0e tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:18.219522 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-a0abed74-c69f-44e8-9cca-f12589918d0e tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:18.227179 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-a0abed74-c69f-44e8-9cca-f12589918d0e tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1575 microversion: 2.1 time: 0.216083 Nov 16 00:38:18.227967 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 583/1161] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:18 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1575 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 00:38:18.541270 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-c57fa1be-5a8a-4eb4-9012-9aeec709a725 req-3b61f226-d7bc-4d65-8889-f44529490fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9", "name": "network-vif-deleted", "tag": "61f19899-f0f1-4180-a1a2-c9d49909a093"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:38:18.542968 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:38:18.542968 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:38:18.550656 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-c57fa1be-5a8a-4eb4-9012-9aeec709a725 req-3b61f226-d7bc-4d65-8889-f44529490fc5 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:18.551126 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-c57fa1be-5a8a-4eb4-9012-9aeec709a725 req-3b61f226-d7bc-4d65-8889-f44529490fc5 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:18.562635 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-c57fa1be-5a8a-4eb4-9012-9aeec709a725 req-3b61f226-d7bc-4d65-8889-f44529490fc5 service nova] Creating event network-vif-deleted:61f19899-f0f1-4180-a1a2-c9d49909a093 for instance a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 on hv-cinder-81115 Nov 16 00:38:18.568357 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-c57fa1be-5a8a-4eb4-9012-9aeec709a725 req-3b61f226-d7bc-4d65-8889-f44529490fc5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030710 Nov 16 00:38:18.568940 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 579/1162] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:38:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:38:18.892318 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-d2b1191a-2fe6-46d2-b2df-d88db4199103 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:18.892992 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-d2b1191a-2fe6-46d2-b2df-d88db4199103 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:18.898653 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d2b1191a-2fe6-46d2-b2df-d88db4199103 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:18.899120 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d2b1191a-2fe6-46d2-b2df-d88db4199103 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:18.899868 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d2b1191a-2fe6-46d2-b2df-d88db4199103 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:18.900290 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d2b1191a-2fe6-46d2-b2df-d88db4199103 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:18.931436 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d2b1191a-2fe6-46d2-b2df-d88db4199103 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:18.932073 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-d2b1191a-2fe6-46d2-b2df-d88db4199103 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:18.932561 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.objects.instance [None req-d2b1191a-2fe6-46d2-b2df-d88db4199103 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lazy-loading 'fault' on Instance uuid a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 {{(pid=122543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:38:18.975123 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-d2b1191a-2fe6-46d2-b2df-d88db4199103 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53025a2dea324aab903a49328416eead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f9b691378844135bec95fb0c25829cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:18.982758 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-d2b1191a-2fe6-46d2-b2df-d88db4199103 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9" status: 200 len: 1303 microversion: 2.1 time: 0.094187 Nov 16 00:38:18.983579 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 584/1163] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:18 2021] GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:19.245148 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-b0acc771-cb9d-4a24-9a5f-754521ff4cbe tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:19.245754 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-b0acc771-cb9d-4a24-9a5f-754521ff4cbe tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:19.251976 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b0acc771-cb9d-4a24-9a5f-754521ff4cbe tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:19.252849 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b0acc771-cb9d-4a24-9a5f-754521ff4cbe tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:19.253618 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b0acc771-cb9d-4a24-9a5f-754521ff4cbe tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:19.254046 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-b0acc771-cb9d-4a24-9a5f-754521ff4cbe tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:19.378096 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-b0acc771-cb9d-4a24-9a5f-754521ff4cbe tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:19.385373 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-b0acc771-cb9d-4a24-9a5f-754521ff4cbe tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1575 microversion: 2.1 time: 0.144357 Nov 16 00:38:19.385940 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 580/1164] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:19 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1575 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:19.999658 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-39c8ec93-be4c-4941-842c-ddfd3d5fa1f7 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:20.000973 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-39c8ec93-be4c-4941-842c-ddfd3d5fa1f7 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] [instance: a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:20.008130 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-39c8ec93-be4c-4941-842c-ddfd3d5fa1f7 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:20.008790 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-39c8ec93-be4c-4941-842c-ddfd3d5fa1f7 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:20.009824 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-39c8ec93-be4c-4941-842c-ddfd3d5fa1f7 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:20.010607 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-39c8ec93-be4c-4941-842c-ddfd3d5fa1f7 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:20.028708 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.wsgi [None req-39c8ec93-be4c-4941-842c-ddfd3d5fa1f7 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] HTTP exception thrown: Instance a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 could not be found. Nov 16 00:38:20.029307 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-39c8ec93-be4c-4941-842c-ddfd3d5fa1f7 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] Returning 404 to user: Instance a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 could not be found. {{(pid=122543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:38:20.030219 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-39c8ec93-be4c-4941-842c-ddfd3d5fa1f7 tempest-VolumesActionsTest-312872325 tempest-VolumesActionsTest-312872325-project] 10.222.0.31 "GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9" status: 404 len: 111 microversion: 2.1 time: 0.034180 Nov 16 00:38:20.031142 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 585/1165] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:19 2021] GET /compute/v2.1/servers/a387f77a-bdf4-4fe1-a0ca-d0ebe1522ff9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:38:20.403322 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-c3fce8ed-66c9-41e6-a5e0-efbfd0ed08b7 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:38:20.404065 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-c3fce8ed-66c9-41e6-a5e0-efbfd0ed08b7 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:38:20.410455 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c3fce8ed-66c9-41e6-a5e0-efbfd0ed08b7 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:20.410973 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c3fce8ed-66c9-41e6-a5e0-efbfd0ed08b7 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:20.411847 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c3fce8ed-66c9-41e6-a5e0-efbfd0ed08b7 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:20.412381 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-c3fce8ed-66c9-41e6-a5e0-efbfd0ed08b7 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:20.547677 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-c3fce8ed-66c9-41e6-a5e0-efbfd0ed08b7 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:38:20.556831 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-c3fce8ed-66c9-41e6-a5e0-efbfd0ed08b7 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1562 microversion: 2.1 time: 0.157225 Nov 16 00:38:20.557400 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 581/1166] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:38:20 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:38:29.025345 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-ac75cfc6-2714-4fc2-86b2-8da6771c9d29 req-c105077b-a338-422e-aa94-767c126586f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2b3498-9dc0-415d-8e78-dee875d29a7f", "name": "network-vif-plugged", "status": "completed", "tag": "e9de811a-ed83-4234-81b8-9dda4ea6612f"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:38:29.027718 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:38:29.027718 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:38:29.038844 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-ac75cfc6-2714-4fc2-86b2-8da6771c9d29 req-c105077b-a338-422e-aa94-767c126586f8 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:38:29.040000 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-ac75cfc6-2714-4fc2-86b2-8da6771c9d29 req-c105077b-a338-422e-aa94-767c126586f8 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:38:29.064018 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-ac75cfc6-2714-4fc2-86b2-8da6771c9d29 req-c105077b-a338-422e-aa94-767c126586f8 service nova] Creating event network-vif-plugged:e9de811a-ed83-4234-81b8-9dda4ea6612f for instance 4d2b3498-9dc0-415d-8e78-dee875d29a7f on hv-cinder-81115 Nov 16 00:38:29.073763 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-ac75cfc6-2714-4fc2-86b2-8da6771c9d29 req-c105077b-a338-422e-aa94-767c126586f8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051794 Nov 16 00:38:29.077633 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 586/1167] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:38:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:40:05.081727 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-d84e441d-b666-48f5-a029-073114ad2f9b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:40:05.082930 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d84e441d-b666-48f5-a029-073114ad2f9b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:40:05.089290 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d84e441d-b666-48f5-a029-073114ad2f9b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:40:05.089730 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d84e441d-b666-48f5-a029-073114ad2f9b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:40:05.090502 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d84e441d-b666-48f5-a029-073114ad2f9b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:40:05.090932 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-d84e441d-b666-48f5-a029-073114ad2f9b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:40:05.117834 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-d84e441d-b666-48f5-a029-073114ad2f9b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Going to try to terminate instance {{(pid=122544) delete /opt/stack/nova/nova/compute/api.py:2612}} Nov 16 00:40:05.203021 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-d84e441d-b666-48f5-a029-073114ad2f9b tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 204 len: 0 microversion: 2.1 time: 0.126400 Nov 16 00:40:05.204036 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 582/1168] 10.222.0.31 () {58 vars in 1238 bytes} [Tue Nov 16 00:40:05 2021] DELETE /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 00:40:05.213836 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-a8414bed-332a-498a-8461-14eca89aeaba tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:40:05.214713 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-a8414bed-332a-498a-8461-14eca89aeaba tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:40:05.221491 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a8414bed-332a-498a-8461-14eca89aeaba tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:40:05.222051 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a8414bed-332a-498a-8461-14eca89aeaba tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:40:05.224130 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a8414bed-332a-498a-8461-14eca89aeaba tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:40:05.224571 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-a8414bed-332a-498a-8461-14eca89aeaba tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:40:05.237692 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [req-7d600bf5-a9f9-4fdf-a606-6d134f9e2ec4 req-84d529ee-c4c7-4b37-bff9-40f245f1998b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d2b3498-9dc0-415d-8e78-dee875d29a7f", "tag": "e9de811a-ed83-4234-81b8-9dda4ea6612f"}]} {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:40:05.239970 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:40:05.239970 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: warnings.warn(msg) Nov 16 00:40:05.247141 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-7d600bf5-a9f9-4fdf-a606-6d134f9e2ec4 req-84d529ee-c4c7-4b37-bff9-40f245f1998b service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:40:05.247573 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [req-7d600bf5-a9f9-4fdf-a606-6d134f9e2ec4 req-84d529ee-c4c7-4b37-bff9-40f245f1998b service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:40:05.259563 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.compute.server_external_events [req-7d600bf5-a9f9-4fdf-a606-6d134f9e2ec4 req-84d529ee-c4c7-4b37-bff9-40f245f1998b service nova] Creating event network-changed:e9de811a-ed83-4234-81b8-9dda4ea6612f for instance 4d2b3498-9dc0-415d-8e78-dee875d29a7f on hv-cinder-81115 Nov 16 00:40:05.267573 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [req-7d600bf5-a9f9-4fdf-a606-6d134f9e2ec4 req-84d529ee-c4c7-4b37-bff9-40f245f1998b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189044 Nov 16 00:40:05.268509 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 587/1169] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:40:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 00:40:05.438063 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.policy [None req-a8414bed-332a-498a-8461-14eca89aeaba tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122544) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:40:05.448510 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-a8414bed-332a-498a-8461-14eca89aeaba tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1568 microversion: 2.1 time: 0.238343 Nov 16 00:40:05.450957 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 583/1170] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:40:05 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:40:06.470448 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-707b4307-66c2-4c9a-ad96-be3d3e2c4be4 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:40:06.471216 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-707b4307-66c2-4c9a-ad96-be3d3e2c4be4 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:40:06.477547 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-707b4307-66c2-4c9a-ad96-be3d3e2c4be4 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:40:06.477990 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-707b4307-66c2-4c9a-ad96-be3d3e2c4be4 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:40:06.478760 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-707b4307-66c2-4c9a-ad96-be3d3e2c4be4 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:40:06.479223 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-707b4307-66c2-4c9a-ad96-be3d3e2c4be4 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:40:06.663207 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-707b4307-66c2-4c9a-ad96-be3d3e2c4be4 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:40:06.670733 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-707b4307-66c2-4c9a-ad96-be3d3e2c4be4 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1449 microversion: 2.1 time: 0.204325 Nov 16 00:40:06.671346 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 588/1171] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:40:06 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1449 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:40:07.323780 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [req-ff4f18ed-d612-4a8f-a106-572815895b85 req-4b9a3c9b-7a16-4c3f-b86d-f3d848597df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2b3498-9dc0-415d-8e78-dee875d29a7f", "name": "network-vif-deleted", "tag": "e9de811a-ed83-4234-81b8-9dda4ea6612f"}]} {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 00:40:07.326677 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 00:40:07.326677 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: warnings.warn(msg) Nov 16 00:40:07.338330 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-ff4f18ed-d612-4a8f-a106-572815895b85 req-4b9a3c9b-7a16-4c3f-b86d-f3d848597df7 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:40:07.338786 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [req-ff4f18ed-d612-4a8f-a106-572815895b85 req-4b9a3c9b-7a16-4c3f-b86d-f3d848597df7 service nova] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:40:07.350996 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.compute.server_external_events [req-ff4f18ed-d612-4a8f-a106-572815895b85 req-4b9a3c9b-7a16-4c3f-b86d-f3d848597df7 service nova] Creating event network-vif-deleted:e9de811a-ed83-4234-81b8-9dda4ea6612f for instance 4d2b3498-9dc0-415d-8e78-dee875d29a7f on hv-cinder-81115 Nov 16 00:40:07.355986 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [req-ff4f18ed-d612-4a8f-a106-572815895b85 req-4b9a3c9b-7a16-4c3f-b86d-f3d848597df7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098096 Nov 16 00:40:07.356593 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 584/1172] 10.222.0.31 () {64 vars in 1317 bytes} [Tue Nov 16 00:40:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 00:40:07.690034 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-25b3cbd0-bb11-4a0e-97de-ac3a531b8ce8 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:40:07.691505 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.compute.api [None req-25b3cbd0-bb11-4a0e-97de-ac3a531b8ce8 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122543) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:40:07.699021 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-25b3cbd0-bb11-4a0e-97de-ac3a531b8ce8 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:40:07.699607 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-25b3cbd0-bb11-4a0e-97de-ac3a531b8ce8 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:40:07.700751 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-25b3cbd0-bb11-4a0e-97de-ac3a531b8ce8 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:40:07.701310 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-25b3cbd0-bb11-4a0e-97de-ac3a531b8ce8 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:40:07.744078 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-25b3cbd0-bb11-4a0e-97de-ac3a531b8ce8 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:40:07.744523 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG oslo_concurrency.lockutils [None req-25b3cbd0-bb11-4a0e-97de-ac3a531b8ce8 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:40:07.744970 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.objects.instance [None req-25b3cbd0-bb11-4a0e-97de-ac3a531b8ce8 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lazy-loading 'fault' on Instance uuid 4d2b3498-9dc0-415d-8e78-dee875d29a7f {{(pid=122543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 16 00:40:07.793243 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.policy [None req-25b3cbd0-bb11-4a0e-97de-ac3a531b8ce8 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456426d38d9c4cd3be59d047a845d8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b1da70dc7334be3be9b115125527150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122543) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 00:40:07.803632 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-25b3cbd0-bb11-4a0e-97de-ac3a531b8ce8 tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 200 len: 1224 microversion: 2.1 time: 0.118032 Nov 16 00:40:07.804218 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 589/1173] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:40:07 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 1224 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 00:40:08.826118 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-9fbe0631-56d5-4496-8cc9-5f5b4122b86a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '>' {{(pid=122544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:40:08.826799 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.compute.api [None req-9fbe0631-56d5-4496-8cc9-5f5b4122b86a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] [instance: 4d2b3498-9dc0-415d-8e78-dee875d29a7f] Fetching instance by UUID {{(pid=122544) get /opt/stack/nova/nova/compute/api.py:2863}} Nov 16 00:40:08.833380 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9fbe0631-56d5-4496-8cc9-5f5b4122b86a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:40:08.833816 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9fbe0631-56d5-4496-8cc9-5f5b4122b86a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:40:08.834574 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9fbe0631-56d5-4496-8cc9-5f5b4122b86a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 16 00:40:08.834988 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG oslo_concurrency.lockutils [None req-9fbe0631-56d5-4496-8cc9-5f5b4122b86a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Lock "9e9e03b1-3ea8-4563-a932-133fe83355c3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 16 00:40:08.848247 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.wsgi [None req-9fbe0631-56d5-4496-8cc9-5f5b4122b86a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] HTTP exception thrown: Instance 4d2b3498-9dc0-415d-8e78-dee875d29a7f could not be found. Nov 16 00:40:08.849012 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: DEBUG nova.api.openstack.wsgi [None req-9fbe0631-56d5-4496-8cc9-5f5b4122b86a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Returning 404 to user: Instance 4d2b3498-9dc0-415d-8e78-dee875d29a7f could not be found. {{(pid=122544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 00:40:08.849827 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO nova.api.openstack.requestlog [None req-9fbe0631-56d5-4496-8cc9-5f5b4122b86a tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f" status: 404 len: 111 microversion: 2.1 time: 0.027749 Nov 16 00:40:08.850325 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: [pid: 122544|app: 0|req: 585/1174] 10.222.0.31 () {58 vars in 1235 bytes} [Tue Nov 16 00:40:08 2021] GET /compute/v2.1/servers/4d2b3498-9dc0-415d-8e78-dee875d29a7f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 00:40:09.014382 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: DEBUG nova.api.openstack.wsgi [None req-718191b4-03a5-41ac-9b74-983704e406ac tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] Calling method '.version_select at 0x7f2f2953f0d0>' {{(pid=122543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 00:40:09.035777 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO nova.api.openstack.requestlog [None req-718191b4-03a5-41ac-9b74-983704e406ac tempest-TestShelveInstance-80160839 tempest-TestShelveInstance-80160839-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1578337872" status: 202 len: 0 microversion: 2.1 time: 0.024200 Nov 16 00:40:09.040066 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: [pid: 122543|app: 0|req: 590/1175] 10.222.0.31 () {58 vars in 1253 bytes} [Tue Nov 16 00:40:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1578337872 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 00:40:18.689196 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 00:40:18.689821 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: Tue Nov 16 00:40:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 00:40:43.665254 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 00:40:43.665998 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: Tue Nov 16 00:40:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 00:40:45.648751 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 00:40:45.649335 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: Tue Nov 16 00:40:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 00:42:15.187401 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 00:42:15.188109 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: Tue Nov 16 00:42:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 00:42:29.454293 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 00:42:29.454939 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: Tue Nov 16 00:42:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 00:43:38.707912 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 00:43:38.708970 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: Tue Nov 16 00:43:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 00:44:03.683292 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 00:44:03.683977 dv-cinder-811154-2-iscsi devstack@n-api.service[122544]: Tue Nov 16 00:44:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 00:44:05.666302 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 00:44:05.666906 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: Tue Nov 16 00:44:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 00:45:31.187776 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 00:45:31.188483 dv-cinder-811154-2-iscsi devstack@n-api.service[122543]: Tue Nov 16 00:45:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!